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(54) Transcoder, transcoding system, and recording medium 



(57) An image coding system converting apparatus 
is arranged by employing input means 102 for sequen- 
tially reading an input bit stream, a decoder unit 103 for 
decoding inputted data, a data buffer 104 for saving 
either non-conpression image data or image data being 
decoded in a half way, an added information buffer 105 
for saving either added information related to image 
data or added information related to a coding system, 
an encoder unit 106 for encoding the image data read 
out from the data buffer 1 04 with reference to the added 
information read out from the added information buffer 
105, and output means 107 for outputting the image 



data encoded by the encoder unit 106. Accordingly, it is 
provided an image coding system converting appara- 
tus, and an image coding system converting method, 
capable of converting an image coded by one image 
coding system into another image coding system in a 
high speed, while suppressing a deterioration of an 
image quality, and also to provide a recording medium 
for recording thereon a computer readable program 
capable of executing the image coding system convert- 
ing method. 
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Description 

BACKGROUND OF THE INVENTION 

[0001 ] The present invention generally relates to an 
image coding system converting apparatus, an image 
coding system converting method, and a recording 
medium for recording a program used to execute this 
converting method. More specifically, the present inven- 
tion is directed to such image coding system converting 
apparatus, image coding system converting method, 
and recording medium, capable of converting a com- 
pression coding system while reducing a necessary cal- 
culation amount and suppressing a deterioration of an 
image quality. 

[0002] Recently, electronic appliances capable of 
processing digital picture (image) signals are increased, 
and the digital picture signals used in these electronic 
appliances are compressed/coded in accordance with 
certain coding systems (will be referred to as an "image 
coding system" hereinafter). There is, however, no com- 
patibility among different image coding systems from 
each other. Thus, a bit stream coded in one electronic 
appliance cannot be decoded by such an electronic 
appliance which performs a coding/decoding operation 
by using another image coding/decoding system, so 
that this coded bit stream cannot be reproduced by the 
latter-mentioned electronic appliance. For instance, 
when coded picture data which have been stored in a 
broadcasting station are broadcasted, the following 
needs may be sometimes made. That is, picture data 
which has been coded based upon one image coding 
system different from another image coding system 
used for the stored picture data is wanted to be decoded 
for a broadcasting purpose. 

[0003] To satisfy such a request the following com- 
pressing/coding system is required. That is, a bit stream 
which has been coded in accordance with a first image 
coding system is decoded, and this decoded bit stream 
is again encoded in accordance with a second image 
coding system. Normally, if the decoder adapted to the 
first image coding system is combined with the encoder 
adapted to the second image coding system, then it 
could realize such a converting apparatus capable of 
performing the above-explained picture data converting 
operation. 

[0004] The major system related to the compress- 
ing/coding systems used in the image coding systems 
for digital picture signals is the hybrid type compress- 
ing/coding system. In this hybrid type compressing/cod- 
ing system, the reduction of the spatial redundancy 
within the block performed by the DCT (discrete cosine 
transform) is combined with the reduction of the tempo- 
ral redundancy between the frames performed by the 
motion compensation. Furthermore, the data is com- 
pressed by employing the entropy coding system. In an 
actual case, this coding system has been introduced 
into all of MPEG-1 used in a video CD and a video clip; 



MPEG-2 used in a DVD and a digital broadcasting sys- 
tem; ITU-T recommendation H.261 used in a television 
conference/television telephone; ITU-T recommenda- 
tion H.263 used in a television telephone operable in an 

s analog line; and also MPEG-4 expectechas the moving 
picture coding system for the next generation. In this 
coding system. DCT, quantizing, motion-compensating, 
and variable-length coding operations are carried out 
[0005] As a result, in the system conversion among 

10 these coding systems, the structures of the actual bit 
streams are resembled to each other. Therefore, while 
the bit stream coded in accordance with the first image 
coding system is decoded, the bit amounts every pic- 
ture and macro-block are counted, so that the process 

75 amount required for the bit rate control and the like 
when the decoded bit stream is coded in accordance 
with the second image coding system can be reduced. 
[0006] For example, Japanese Patent Disclosure 
No. Hei-9-512410 discloses "METHOD FOR CODE- 

20 CONVERTING CODED VIDEO SIGNAL AND CODE 
CONVERTING APPARATUS WITH USING CODE- 
CONVERTING METHOD THEREOF" so as to reduce 
the process amount. Now, this code converting appara- 
tus 2000 will be simply explained as prior art with refer- 

25 ence to Fig. 1 7. 

[0007] Fig. 17 is a block diagram for simply repre- 
senting the structural arrangement of the code convert- 
ing apparatus described in Japanese Patent Disclosure 
No. Hei-9-512410. This code converting apparatus 

30 2000 is arranged by employing the decoding sub- 
assembly 2001 and the coding sub-assembly 2002. The 
decoding sub-assembly 2001 contains a demultiplexing 
circuit 2003 having a function for subdividing the input 
bit stream into the respective layers, and the normal 

35 decoder 2004. Also, the coding sub-assembly 2002 
contains the frame memory 2005, the delay circuit 
2006, the normal encoder 2007, the bit rate control cir- 
cuit 2008, the target bit calculator 2009. and the output 
buffer 2010. 

40 [0008] The decoder 2004 decodes the input bit 
stream which has been decoded, and contains the vari- 
able length decoding means, the dequantizing means, 
the inverse- DCT means, and the like. Also, the encoder 
2007 encodes the non-corrpression image data, and 

45 contains the variable length coding means, the quantiz- 
ing means, the DCT means, the frame memory, the 
motion compensating means, and the like. Also, both 
the bit rate control circuit 2008 and the target bit calcu- 
lator 2009 determine the quantizing steps in the actual 

so coding operation by referring to the bit amount of the 
output bit stream. It should be noted that the code con- . 
verting apparatus 2000 is not equipped with a pre-ana- 
lyzer having a similar circuit arrangement to that of an 
encoder. This pre-analyzer encodes an input image at a 

55 quantizing step preceding to the step for encoding the 
input image by the encoder. 

[0009] Next, the operations of the code converting 
apparatus 2000 will now be simply explained. 
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[0010] The demultiplexing circuit 2003 separates 
the input bit stream into the coded data and the over- 
head other than this coded data, for example, the 
header information and the start code. Both the coded 
data and the overhead are supplied to the decoder 2004 
and the target bit calculator 2009, respectively. In the 
decoder 2004, the supplied data is decoded, and the 
non-compression image data is sequentially written into 
the frame memory 2005. The target bit calculator 2009 
counts the bit amount "B" of each of the sub-images 
such as the macroblocks from both the data and the 
overhead. Next, the counted bit amounts "B" are added 
to each other over the entire image so as to acquire the 
bit amount "S" of one image. Furthermore, the activity 
"X" of this image is obtained by multiplexing a certain 
quantizing step "Q2" by the bit amount "S" of one image. 
[0011] The target bit calculator 2009 contains the 
memory, and calculates the bit T of the present frame 
based upon the activity "Xpre" of the preceding frame 
and the obtained activity "X". The target bit T is distrib- 
uted to the local target value Tn" every macroblock by 
the distributing circuit provided in the target bit calcula- 
tor 2009, and then the local target value Tn" is sent to 
the bit rate control circuit 2008. The bit rate control cir- 
cuit 2008 calculates the quantizing step n QV to be cor- 
rected from the supplied local target value "Tn" and the 
condition *b" (packing density) of the output buffer 2010. 
and then supplies the calculated quantizing step Q1 to 
the quantizing means (not shown) employed in the 
encoder 2007. After the non-compression image has 
passed through the delay circuit this non-compression 
image is supplied to the encoder 2007 so as to be 
encoded. At this time, the quantizing means provided in 
the encoder 2007 quantizes the non-compression 
image by using the quantizing step Q1 . The encoder 
2007 sequentially outputs the encoded bit stream to the 
buffer 2010. 

[0012] As previously explained, the code converting 
apparatus 2000 can make the bit rate of the input bit 
stream equal to the bit rate of the output bit stream, 
while the pre-analyzer can be omitted, in such a manner 
that the bit stream is demultiplexed by the demultiplex- 
ing circuit 2003 and then the demultiplexed bit streams 
are entered to the target bit calculator 2009. 
[0013] However, in the above-described conven- 
tional code converting apparatus 2000, when the 
demultiplexing circuit 2003 demultiplexes the input bit 
stream up to the macroblock layer, since this demulti- 
plexing circuit 2003 requires the variable length decod- 
ing function, there are various problems that the circuit 
scale is increased and furthermore, the calculation 
amount is increased. There is another problem that the 
calculation amount required for performing the decod- 
ing operation by the decoder and also the calculation 
amount required for executing the encoding operation 
by the encoder are not reduced, as compared with such 
a case that the decoder is merely connected in series 
with the encoder. In addition, as indicated in Fig. 18. 
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after such an input bit stream which has been once 
coded is completely decoded, this decoded input bit 
stream is again coded. As a result, there is a further 
problem that the deterioration occurs in the image qual- 
5 ity. 

SUMMARY OF THE INVENTION 

[0014] The present invention has been made to 

io solve the problems, and therefore, has an object to pro- 
vide an image coding system converting apparatus, and 
an image coding system converting method, capable of 
converting an image coded by one image coding sys- 
tem into another image coding system in a high speed, 

is while suppressing a deterioration of an image quality, 
and also to provide a recording medium for recording 
thereon a computer readable program capable of exe- 
cuting the image coding system converting method. 
[0015] in the image coding system converting 

20 apparatus and the image coding system converting 
method according to the present invention, the separa- 
tion means (step) separates the input data into the 
coded image data and the added information data, this 
image data is produced by coding a picture in the unit of 

25 a block, which owns a plurality of blocks constituted by 
a predetermined number of pixels, and the added infor- 
mation data contains data amount information of the 
picture; the decoding means (step) inverse-orthogonal- 
transforms the coded image data; the allocation means 

30 (step) allocates the upper limit data amount to the 
respective blocks owned by the picture based upon the 
data amount information of the picture; and the coding 
means (step) cuts the data of the subject block in such 
a case that the data amount of the subject block is 

35 larger than, or equal to the upper limit data amount set 
to the subject block, and inverse-orthogonal-transforms 
the cut data. 

[0016] In the image coding system converting 
apparatus and the image coding system converting 

40 method of the present invention, . the separation means 
(step) separates the input data into the coded image 
data and the added information data, this image data is 
produced by coding a picture in the unit of a block, 
which owns a plurality of blocks constituted by a prede- 

45 termined number of pixels, and the added information 
data contains data amount information of the plurality of 
blocks; the decoding means (step) inverse-orthogonal- 
transforms the coded image data; the allocation means 
(step) sets the upper limit data amount of the respective 

so blocks based upon the data amount information of the 
picture; and the coding means (step) cuts the data of 
the subject block in such a case that the data amount of 
the subject block is larger than, or equal to the upper 
limit data amount set to the subject block and inverse- 

55 orthogonal-transforms the cut data. 

[0017] As previously explained, in the decoding 
means (decoding step), only the inverse-orthogonal- 
transforming operation is performed while both the 
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dequantizing operation and the inverse DCT transform- 
ing operation are not carried out, and in the coding 
means (coding step), only the orthogonal transforming 
operation is carried out while both the DCT transforming 
operation and the quantizing operation are not carried 
out As a result the calculation amount required for con- 
verting a certain image coding system into another 
image coding system can be largely reduced. Accord- 
ingly, it is possible to provide the image coding system 
converting apparatus, the image coding system con- 
verting method, and the recording medium, by which 
the highspeed image coding system converting opera- 
tion can be realized. Also, since the data of the block is 
cut based upon the upper limit data amount, even when 
a certain image coding system is converted into another 
different image coding system, these image coding sys- 
tems can be converted at the substantially same bit rate 
as the original bit rate without giving any large adverse 
influence to the image quality. 

[0018] Further, according to the present invention, 
the separation means (step) separates the input data 
into the coded image data and the added information 
data, this image data is produced by coding a picture in 
the unit of a block, which owns a plurality of blocks con- 
stituted by a predetermined number of pixels, and the 
added information data contains coding information of 
the each block and quantizing parameter information; 
the block coding system judging means (step) judges 
the coding system of the subject block with reference to 
the coding information of the subject block; the decod- 
ing means (step) executes either the inverse-orthogo- 
nal-transform operation and the dequantizing operation 
with respect to the subject block in response to such a 
judgement result made of the block coding system judg- 
ing means (step); the coding means (step) includes the 
quantizing parameter output means (step) for outputting 
a new quantizing parameter based upon the quantizing 
parameter information, wherein the first coding means 
(step) is performed which orthogonal-transforms such a 
block which has been inverse-orthogonal-transformed 
by the decoding means (step) without quantizing the 
block; and the coding means (step) wherein as to such 
a block which has been inverse-orthogonal-transformed 
and dequantized by the decoding step, after the new 
quantizing parameter outputted from the quantizing 
parameter output means (step) is multiplied by the DCT 
coefficient of the block, the second coding means (step) 
quantizes and also orthogonal-transforms the block. 
[0019] More specifically, the block coding system 
judging means (step) judges as to whether the subject 
block corresponds to the intra-coded block, or the inter- 
coded block; and when the block coding system judging 
means (step) judges that the subject block corresponds 
to the intra-coded block, the decoding means (step) 
inverse-orthogonal-transforms the subject block judged 
as the intra-coded block, whereas when the block cod- 
ing system judging means (step) judges that the subject 
block corresponds to the inter-coded block, the decod- 



ing means (step) inverse-orthogonal-transforms and 
also dequarrtizes the subject block judged as the inter- 
coded block. 

[0020] As described above, since the quantized 
s DCT coefficient is directly used for the intra-coded type 
block, both the dequantizing calculation required in the 
decoding means (decoding step), and also the quantiz- 
ing calculation required in the coding means (coding 
step) can be omitted. Accordingly, the highspeed image 
w coding system converting operation can be realized. 
Also, as to the inter-coded type block, the new quantiz- 
ing parameter is produced by multiplying the new quan- 
tizing parameter by the DCT coefficient of this block, 
and this inter-coded type block is requantized by using 
is this new quantizing parameter. Therefore, even when a 
certain image coding system is converted into another 
different image coding system, these image coding sys- 
tems can be converted at the substantially same bit rate 
as the original bit rate without giving any large adverse 
20 influence to the image quality. 

[0021] Also, the block coding system judging 
means (step) judges as to whether the subject block 
corresponds to the intra-coded block, or the inter-coded 
block; and when the block coding system judging 
25 means (step) judges that the subject block corresponds 
to the intra-coded block, the decoding means (step) 
inverse-orthogonal-transforms the subject block judged 
as the intra-coded block, whereas when the block cod- 
ing system judging means (step) judges that the subject 
30 block corresponds to the inter-coded block, and further 
judges as to whether the coding system of the block 
belonging to the frame time-sequentially succeeded to 
the frame to which the subject block, and located at the 
same position of the subject block corresponds to the 
35 intra-coded block, or the inter-coded block; when the 
judged block corresponds to the intra-coded block, the 
decoding means (step) inverse-orthogonal-transforms 
the subject block judged as the intra-coded block, 
whereas when the judged block corresponds to the 
40 intra-coded block, the decoding means (step) inverse- 
orthogonal-transforms and also dequarrtizes the subject 
block judged as the inter-coded block. 
[0022] As previously explained, the quantized DCT 
coefficient is directly employed with respect to both the 
45 intra-coded type block, and also such an inter-coded 
type block that the coded type of the block corresponds 
to the intra-coded type block, and this block is located at 
the same position as that of the subject block of such a 
frame time-sequentially subsequent to the frame to 
so which the subject block belongs. As a result the 
dequantizing calculation required in the decoding _ 
means (decoding step), and also the quantizing calcula- 
tion required in the coding means (coding step) can be 
omitted. Accordingly, the more highspeed image coding 
55 system converting operation can be provided. Also, the 
blocks other than the above-explained block may readily 
cause the image qualities to be deteriorated while the 
blocks located at the same positions within the time- 
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sequentially subsequent frame are such inter-coded 
type blocks. However, these blocks may become the 
intra-coded type blocks in future. Therefore, it is possi- 
ble to realize such an image coding type converting 
operation while suppressing the deterioration in the 5 
image qualities. It should also be noted that since a total 
number of frames to be judged by the above-explained 
block coding system judging step is reduced, the time 
duration when the deterioration in the image quality 
occurs can be shortened. 10 
[0023] Also, the added information contains bit 
amount information of each of the blocks; the block cod- 
ing system judging means (step) judges as to whether 
the subject block corresponds to the intra-coded block, 
or the interceded block; and when the block coding sys- is 
tern judging means (step) judges that the subject block 
corresponds to the intra-coded block, the decoding 
means (step) inverse-orthogonal-transforms the subject 
block judged as the intra-coded block, whereas when 
the block coding system judging means (step) judges 20 
that the subject block corresponds to the inter-coded 
block, the decoding means (step) either inverse-orthog- 
onal-transforms or inverse-orthogonal -transforms and 
also dequantizes the subject block judged as the inter- 
coded block based upon an activity indicative of a 25 
degree of coding difficulty which is acquired by multiply- 
ing the bit amount of the subject block by the quantizing 
parameter. 

[0024] As previously explained, since the activity is 
used, the simple calculation can be used to judge that 30 
the quantized DCT coefficient can be directly employed 
to which block among the inter-coded system block. As 
a result, the highspeed image coding system converting 
operation can be realized with smaller calculation 
amounts than those of the prior art. 
[0025] Also, the transforming-coeff icient calculating 
means (step) calculates the transforming coefficient 
based upon a difference in compression ratios 
before/after the image coding systems are converted; 
and in the quantizing parameter output means (step), 
when the transforming coefficient calculated by the 
transforming-coefftcient calculating step is larger than 1. 
the quantizing parameter output means (step) sets the 
new quantizing parameter as the multiplier indicated by 
the quantizing parameter information; whereas when 
the transforming coeff icient is smaller than 1 , the quan- 
tizing parameter output step sets the new quantizing 
parameter as the divisor indicated by the quantizing 
parameter information and outputs the new quantizing 
parameter. 

[0026] As a consequence, even when a certain 
image coding system is converted into another different 
image coding system having a different compression 
ratio from that of the first-mentioned image coding sys- 
tem, the quantizing error can be reduced. This quantiz- 
ing error corresponds to a difference between the DCT 
coefficient dequantized by the original quantizing 
parameter and the DCT coefficient quantized by the 



new quantizing parameter. As a result, the image cod- 
ing system converting operation can be realized while 
suppressing the deterioration in the image quality 
caused by the quantizing error related to the quantizing 
transform. 

[0027] More specifically, the quantizing parameter 
output means (step) outputs the original DCT coefficient 
as the DCT coefficient as the block in such a case that 
while either the multiplier of the quantizing parameter or 
the divisor thereof indicated by the quantizing parame- 
ter information is used as the new quantizing parameter, 
the DCT coefficient obtained by multiplying the DCT 
coefficient of the block by the multiplier, or the divisor 
becomes smaller than the original DCT coefficient. 
[0028] When the DCT coefficient obtained by multi- 
plying the new quantizing parameter by the DCT coeffi- 
cient of the block becomes smaller than the original 
DCT coefficient, the quantizing error will occur, resulting 
in the deterioration of the image quality. Therefore, such 
an image coding system converting operation can be 
realized while considerably suppressing the image qual- 
ity deterioration caused by the quantizing errors related 
to the quantizing transform, in accordance with the 
above-explained converting apparatus, method, and 
recording medium. 

[0029] Also, the transforming coefficient may be 
preferably equal to such a value obtained by dividing the 
compression ratio of the coding system before the cod- 
ing system is converted by the compression ratio of the 
coding system after the coding system is converted. 
[0030] Also, the added information data contains 
the data amount information of the picture; the upper 
limit data amount calculation means (step) for calculat- 
ing the upper limit data amount of the picture based 
upon the data amount information of the picture; and the 
transforming coefficient may be preferably equal to such 
a value calculated by the ratio of the data amount indi- 
cated by the data amount information of the picture to 
the upper limit amount of the picture calculated by the 
upper limit data amount calculating means (step). 
[0031 ] Also, the transforming coefficient is equal to 
a predetermined value which is previously determined 
in response to the quantizing parameter indicated by 
the quantizing parameter information every combination 
45 between the coding system before being converted and 
the coding system after being converted. 
[0032] As previously explained, since the quantiz- 
ing parameter corresponding to the transform coeffi- 
cient is previously determined, the highspeed image 
so coding system converting operation with a small calcu- 
lation load can be realized. 

[0033] Also, the quantizing parameter output 
means (step) determines the new quantizing parameter 
of the subject block based upon the quantizing parame- 
55 ters of a plurality of continuous blocks subsequent to the 
subject block with respect to the block which is inverse- 
orthogonal-transformed and dequantized by the decod- 
ing step. 
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[0034] As explained above, when the new quantiz- 
ing parameter of the subject block is determined, the 
block subsequent to this subject block is prior-read so 
as to increase/decrease the optimum quantizing param- 
eter. As a result it is possible to suppress a total 5 
number of blocks in which the deterioration in the image 
quality will occur in connection with the transform of the 
quantizing parameter. 

[0035] Furthermore, when both the image coding 
system converting apparatus and the image coding sys- 10 
tern converting method output the image data which has 
been coded in connection with the MPEG-4 standard, 
the quantizing parameter output means (step) reads the 
respective quantizing parameters of a plurality of contin- 
uous macroblocks with respect to a subject block which is 
is inverse-orthogonal -transformed and dequantized by 
the decoding means (step) so as to determine a set 
region of adjoining macroblocks whose quantizing 
parameters are smaller than a predetermined value; 
and determines the quantizing parameter of the subject 20 
macroblock based upon the quantizing parameters of a 
plurality of continuous macroblocks subsequent to the 
subject macroblock within the set region. 
[0036] In the MPEG-4 standard, there is such a lim- 
itation that a difference in the quantizing parameters 25 
between the adjoining macroblocks must be selected to 
be smaller than, or equal to ±2. As a result, when a new 
quantizing parameter is desirably selected to be larger 
than, or equal to ±3, such a set area of the adjoining 
macroblocks is determined, in which the difference in 30 
the quantizing parameters is smaller than a preselected 
value. Thus, the difference in the quantizing parameters 
among the macroblocks within this set area may be 
made smaller than, or equal to ±2. Accordingly, such a 
new quantizing parameter can be determined irrespec- 35 
tive of the above-explained limitation. Therefore, it is 
possible to realize the image coding system converting 
operation with high flexibility. 

[0037] Furthermore, a recording medium, accord- 
ing to the present invention, is featured by such a 40 
recording medium for recording thereon as a computer 
readable program, the image cocfing system converting 
method as mentioned above. 



Fig. 5 is a block diagram for showing an internal 
arrangement of an encoder unit; 
Fig. 6 is an explanation diagram for explaining a cal- 
culation of a DCT coefficient with employment of a 
quantizing parameter; 

Fig. 7 is an explanation diagram for explaining a bit 
cut process operation executed by variable length 
coding means; 

Fig. 8 is a flow chart for explaining an encoding 
process operation performed by the encoder unit; 
Fig. 9 is an explanatory diagram for showing a first 
embodiment of the image coding system converting 
method according to the first embodiment mode; 
Fig. 10 is an explanatory diagram for indicating a 
second embodiment of the image coding system 
converting method according to the first embodi- 
ment mode; 

Fig. 11 is an explanatory diagram for explaining an 
occurrence of a quantizing error and a method for 
determining a quantizing parameter according to 
the second embodiment; 

Fig. 12 is an explanatory diagram for explaining a 
conversion table; 

Fig. 1 3 is a block diagram for indicating an arrange- 
ment of an image coding system converting appa- 
ratus according to a second embodiment mode of 
the present invention; 

Fig. 14 is an explanatory diagram for representing 
an image coding system converting method 
according to the second embodiment mode; 
Fig. 15 is an explanatory diagram for explaining a 
decision of a quantizing parameter by way of a 
prior-reading system of a macroblock; 
Fig. 16 is an explanatory diagram for indicating a 
production of a Vpacket" and one example thereof; 
Fig. 17 is a block diagram for simply indicating the 
arrangement of the code converting apparatus 
described in Japanese Patent Disclosure No. Hei- 
9-512410; 

Fig. 18 is an explanatory diagram for explaining the 
process flow operation of the conventional coding 
system converting method. 
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DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 



[0038] 



Fig. 1 is a block diagram for showing an arrange- 
ment of an image coding system converting appa- so 
ratus according to a first embodiment mode of the 
present invention; 

Fig. 2 is a block diagram for representing an internal 
arrangement of a decoder unit; 
Fig. 3 is a flow chart for describing a decoding proc- ss 
ess operation executed by the decoder unit; 
Ftg. 4 is an explanatory diagram for explaining a for- 
mat of data written into an added information buffer; 



[0039] Referring now to drawings, an image coding 
system converting apparatus, an image coding system 
converting method, and a record ng medium, according 
to the present invention, will be described in detail in this 
order of [FIRST EMBODIMENT MODE] and [SECOND 
EMBODIMENT MODE], ft should be understood that 
both the image coding system converting apparatus 
and the image cocfing system converting method, 
according to the present invention, will be described in 
detail in the respective explanations of these embodi- 
ment modes. However, as to the recording medium 
according to the present invention, since this recording 
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medium merely records thereon a computer program 
used to execute the image coding system converting 
method according to the present invention, a descrip- 
tion of this computer program may be involved in the 
below-mentioned description of this image coding sys- < 
tern converting method. It should also be noted that the 
present invention is not limited to these embodiment 
modes, but may be modified, changed, and substituted 
without departing from the technical scope and spirit of 
the present invention. 

[0040] The image coding system converting appa- 
ratus, accorcfing to the present invention, again com- 
presses/codes a moving picture bit stream which has 
been compressed/coded by way of a certain coding 
system in accordance with another coding system dif- 
ferent from the first-mentioned coding system, and then 
outputs the compressed/coded moving picture bit 
stream. As to such a coding system directed to the 
image coding system converting apparatus and the 
image coding system converting method, according to 
the present invention, process operations are carried 
out, for instance, the orthogonal-transforming operation 
such as a DCT (discrete cosine transform), the quantiz- 
ing operation, the variable length coding operation, the 
motion compensating operation, and the entropy coding 
operation. As an example of these coding systems, the 
ITU-T recommendation H.261 and H.263. the MPEG-1. 
the MPEG-2. the MPEG-4 are conceivable. 

[FIRST EMBODIMENT MODE] 

[0041] Fig. 1 is a block diagram for incGcating an 
arrangement of an image coding system converting 
apparatus accorcfing to a f irst embodiment mode of the 
present invention. 

[0042] In this drawing, the image coding system 
converting apparatus 100, according to this first embod- 
iment, is arranged by employing input means 102, a 
decoder unit 103 corresponding to the decoding means 
defined in the scope of claim for a patent, a data buffer 
104, an added information buffer 105, an encoder unit 
106 corresponding to the coding means thereof, and 
output means 107. 

[0043] First, the input means 102 sequentially 
reads an input bit stream 101 for 1 frame and stores the 
read input bit stream 101 into an internal bit buffer (not 
shown). When the storage content of this bit buffer 
becomes empty, the input means 1 02 reads the input bit 
stream 101 of the next 1 frame and then stores the read 
input bit stream 1 01 into this bit buffer. 
[0044] Also, the decoder unit 103 sequentially 
receives the necessary data, from the bit buffer of the 
input means 102, and then decodes the entered data. 
Also, the decode unit 103 saves either non-compres- 
sion image data or such image data decoded in a half 
way into the data buffer 104. This non-compression 
image data, has been completely decoded up to YUV 
(symbol T indicates luminance signal, and symbols 



"IT and T represent color difference signals). Also, the 
decoder unit 103 saves either added information related 
to image data or added information related to a coding 
system into the added information buffer 105. 

s [0045] Also, this data buffer 104 saves thereinto 
either the non-compression image data or the image 
data decoded in a half way. Also, the added information 
buffer 105 saves thereinto either the added information 
related to the image data or the added information 

10 related to the coding system. 

[0046] Also, the encoder unit 106 encodes, or 
codes the image data read out from the data buffer 104. 
At this time, the encoder unit 1 06 executes the encoding 
operation in response to the added information which is 

is read out from the added information buffer 105. Also, 
the encoder unit 106 sequentially saves the coded 
image data into a bit buffer (not shown) contained by the 
output means 107. 

[0047] Furthermore, when the coded data for 1 
20 frame is saved in a bit buffer (not shown) employed 
inside the output means 107, this output means 107 
sequentially outputs this 1 -frame coded data as an out- 
put bit stream 108. 

[0048] Next, an internal arrangement and operation 
25 of the decoder unit 103 will now be explained more in 
detail. First, the internal arrangement of the decoder 
unit 103 is explained with reference to Fig. 2. Fig. 2 is a 
schematic block diagram for indicating the internal 
arrangement of the decoder unit 103. The decoder unit 

30 103 is arranged by employing upper layer information 
decoding means 201 (corresponding to "separation 
means" defined in scope of claim for this patent). MB 
information decoding means 202 (corresponding to 
"block coding system judging means" thereof), variable 

35 length decoding means 203, dequantizing means 204, 
inverse-DCT means 205, motion compensating means 
206, and a frame memory 207. 
[0049] First the upper layer information decoding 
means 201 decodes layer information of such layers 

40 higher than, or equal to a picture layer among layers 
which constitute a moving picture bit stream layer. For 
example, in the case of MPEG-2. since the moving pic- 
ture bit stream sequence is constituted by the six layers, 
namely "sequence layer*; "GOP (Group Of Picture) 

45 layer"; "picture layer"; "slice layer"; "macroblock layer, 
and "block layer" in the order from the uppermost layer, 
this upper layer information decoding means 201 
decodes the information related to both the sequence 
layer and the GOP layer. 

so [0050] Also, the MB information decoding means 
202 decodes the MB information specific to each of 
macroblocks (MBs). It should be understood that a 
"macroblock" implies a combination of 2 blocks X 2 
blocks (also referred to as "sub-blocks") as to a lumi- 

55 nance signal. One sub-block is constituted by 8 X 8 pix- 
els, so that one macroblock is constituted by 16 X 16 
pixels. 

[0051] Also the variable length decoding means 
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203 variable-length-decodes a variable-length-coded 
macroblocK the dequantizing means 204 dequantizes 
the variable-length-decoded macroblocK and also, the 
inverse-DCT means 205 inverse-DCT-transforms the 
dequantized macroblocK 

[0052] More specifically, the dequantizing means 

204 selectively dequantizes the variable-decoded-mac- 
roblocK depending upon such a fact as to whether a 
macroblock corresponds to an "intra(l)" type macrob- 
locK or a "inter(P)" type macroblock Also, the inverse- 
DCT means 205 selectively inverse-DCT-transforms the 
dequantized macroblocK depending upon such a fact 
as to whether a macroblock corresponds to an "intra" 
type macroblocK or an "inter" type macroblocK 
[0053] It should also be noted that an "intra(IT type 
macroblock corresponds to both a quantized DCT coef- 
ficient and a quantizing parameter, which are variable- 
coded, On the other hand, an "inter(P)" type macroblock 
corresponds to a quantized DCT coefficient which is 
variable-coded in combination with a motion vector and 
also a quantizing parameter in accordance with the 
below-mentioned manner. That is, a predicted macrob- 
lock contained in a frame time-sequentially preceding to 
a subject frame and containing the smallest error with 
respect to a subject macroblock. Then, a motion vector 
indicative of a relative position with respect to this pre- 
dicted macroblock is detected, and thus, an optimum 
predicted macroblock is acquired based upon this 
detected motion vector. A differential macroblock equal 
to a difference between the subject macroblock and the 
predicted macroblock corresponding thereto is DCT- 
transformed, and thereafter, the above-explained quan- 
tizing DCT coefficient which is obtained by quantizing 
the DCT coefficient is variable-length-coded together 
with both the motion vector and the quantizing parame- 
ter. In other words, an intra-macroblock corresponds to 
such a macroblock which is coded without motion com- 
pensation, whereas an inter-macroblock corresponds to 
such a macroblock which is coded with being motion- 
compensated (namely, prediction-coded with motion 
compensation). 

[0054] Also, the motion compensating means 206 
receives such a macroblock which has been variable- 
length-decoded by the variable length decoding means 
203 and also has been quantized/DCT-transformed, 
and then outputs this received macroblock to the data 
buffer 104 in the case that the macroblock is the "intra"- 
macroblock On the other hand, when the macroblock is 
the "inter"-macroblocK the motion compensating 
means 206 receives both a differential macroblock and 
a motion vector, which have been variable-length- 
decoded by the variable length decoding means 203, 
have been dequantized by the dequantizing means 204, 
and have been inverse-DCT-transformed by the inverse- 
DCT means 205. Thereafter, this motion compensating 
means 206 cuts out a predicted macroblock based upon 
both the received motion vector and the preceding 
frame which has been previously decoded and stored 



into the frame memory 207, and then adds the received 
differential macroblock to this predicted macroblocK 
[0055] Furthermore, the frame memory 207 tempo- 
rarily stores the decoded frame, the decoded macrob- 

5 locks are sequentially stored from the motion 
compensating means 206 into this frame memory 207. 
[0056] Referring now to Fig. 3, a description will be 
made of a decoding process operation, according to this 
first embodiment mode, executed by the decoder unit 

10 1 03 containing these structural elements. Fig. 3 is a flow 
chart for describing the decoding process operation 
executed by this decoder unit 103. First, at a step SI 01 , 
the upper layer intonation decoding means 201 reads 
out a start code, layer information, and the like of each 

is of these layers, and then decodes time information on 
which timing is recorded. This timing is used to output a 
picture contained in a picture layer on a screen. The 
upper layer information decoding means 201 supplies 
this decoded time information as "Time-info" to the 

20 added information buffer 105. 

[0057] Next, at a step S102, the upper layer infor- 
mation decoding means 201 judges as to whether or not 
the picture to be decoded corresponds to a first picture. 
When this picture is not equal to the f irst picture, the 

25 decoding process operation is advanced to a step 
S1 03. whereas when this picture is equal to the first pic- 
ture, the decoding process operation is advanced to a 
step S1 04. At the step S1 03, the upper layer information 
recording means 201 supplies a total bit amount as "pic- 

30 bit-amount" to the added information buffer 105. This 
total bit amount is defined from the start code of the pre- 
ceding picture up to the start code of the next picture. 
Then, the decoding process operation is advanced to 
the step S104. 

35 [0058] At this step S1 04, the MB information decod- 
ing means 202 decodes information related to the 
respective macroblocks, and then supplies the quatizing 
parameter as "Quant", the type of macroblock such as 
the Intra" type macroblock or the "inter" type macrob- 

40 lock as "MB-type", and the coded/non-coded informa- 
tion for each block contained in the macroblock as "MB- 
coded" to the added information buffer 105. 
[0059] Next at a step S105, the MB information 
decoding means 202 judges as to whether or not the 

45 macroblock to be decoded corresponds to a first mac- 
roblocK When this macroblock is not equal to the first 
macroblocK the decoding process operation is 
advanced to a step S106, whereas when this macrob- 
lock is equal to the f irst macroblocK the decoding proc- 

so ess operation is advanced to a step S107. At the step 
S106, the MB information recording means 202 sup- . 
pOes a total bit amount as "MBbrt-amount" to the added 
information buffer 105. This total bit amount is defined 
from the preceding macroblock up to the next rnacrob- 

55 locK Then, the decoding process operation is advanced 
to the step S1 07. 

[0060] At the step S1 07, the MB information decod- 
ing means 202 judges as to whether the macroblock to 
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be decoded corresponds to the "intra" type macroblock. 
or the "inter" type macroblock. When this macroblock to 
be decoded corresponds to the "intra" type macroblock, 
the decoding process operation is advanced to a step 
S108, whereas when this macroblock to be decoded 
corresponds to the Intra" type macroblock, the decod- 
ing process operation is advanced to a step S109. At 
the step SI 08 (in case o1 intra type macroblock), the 
variable length decoding means 203 variable-length- 
decodes this intra type macroblock to thereby obtain a 
quantized and DCT-transformed macroblock. This 
resulting macroblock is directly supplied to the motion 
compensating means 206 without through both the 
dequatizing means 204 and the inverse-DCT means 
205. 

[0061 1 On the other hand, at the step S1 09 On case 
of inter type macroblock), the inter type macroblock is 
variable-length-decoded by the variable length decod- 
ing means 203, is dequantized by the dequantizing 
means 204, and is inverse-DCT-transformed by the 
inverse-DCT means 205 so as to decode both a differ- 
ential macroblock and a motion vector. Thus, these dif- 
ferential macroblock and motion vector are supplied 
from the inverse-DCT means 205 to the motion com- 
pensating means 206. Next, at a step S1 10, the motion 
compensating means 206 cuts out a predicted macrob- 
lock by using both the preceding frame and the preced- 
ing motion vector, which have been previously decoded 
and have been stored into the frame memory 207. 
Then, the motion compensating means 206 adds the 
differential macroblock to this predicted macroblock. At 
this time, when the precision of this cut predicted mac- 
roblock is low, an image decoded by employing this pre- 
dicted macroblock would be deteriorated. 
[0062] When the decoding process operation 
defined at either the step S108 or the step S1 10, this 
decoding process operation is advanced to a further 
step S111. at which the motion compensating means 
206 outputs the macroblock which is quantized and 
DCT-transformed to the data buffer 104 when the mac- 
roblock corresponds to the intra type macroblock. When 
the macroblock is the inter type macroblock, the motion 
compensating means 206 outputs such a non-compres- 
sion macroblock which has been produced by adding 
the cBfferential macroblock to the predicted macroblock 
to the data buffer 104. 

[0063] Next, at a step S1 12, a check is made as to 
whether or not the decoded macroblock corresponds to 
the last macroblock. When this decoded macroblock is 
not equal to the last macroblock, the decoding process 
operation is returned to the previous step S1 04 at which 
the decoding process operation defined after the S104 
is carried out with respect to the next macroblock. To the 
contrary, when this decoded macroblock is equal to the 
last macroblock, the decoding process operation is 
advanced to a step S1 13. At this step S1 1 3, a check is 
made as to whether or not the decoded picture corre- 
sponds to the last picture. When this decoded picture is 



not equal to the last picture, the decoding process oper- 
ation is returned to the previous step S101 at which the 
decoding process operation defined after the S101 is 
carried out with respect to the next picture. To the con- 
5 trary, when this decoded picture is equal to the last pic- 
ture, this decoding process operation is completed. 
[0064] Fig. 4 represents one format of data written 
into the added information buffer 105 when one picture 
is decoded. In this data format shown in Fig. 4, this data 
io contains "Tlme-infor" corresponding to time information 
of a certain picture, and "Pictbrt-amounr corresponding 
to a total bit of this picture Furthermore, while using as 
one set "Quat" equal to the quantizing parameter; "MB- 
type" equal to the macroblock type; "MB-coded" equal 
is to the coded/non-coded information of the macroblock; 
and "MBbit-amounr equal to a total bit of one macrobit, 
this data contains plural sets of the above-explained 
information which are equal to a total number of macro- 
bits owned by this picture. It should also be noted that 
20 "GOBbit-amount" corresponding to a total bit amount of 
GOBs (Group of Blocks), namely a group of macrob- 
locks, and "Blockbit-amount" corresponding to a bit 
amount for each of blocks may be written into the added 
information buffer 105. All of the above-explained infor- 
ms mation will be referred to as "added information". 

[0065] Next an internal arrangement and operation 
of the encoder unit 106 will now be explained in detail. 
First, the internal arrangement of the encoder unit 106 
is described with reference to Fig. 5. Fig. 5 is a block 
30 diagram for schematically indicating the internal 
arrangement of the encoder unit 106. This encoder unit 
106 is arranged by employing a bit rate control unit 51 1 
corresponding to either a transform coefficient calculat- 
ing means or an upper limit data amount calculating 
35 means, a subtracter 501 , a DCT means 502, quantizing 
means 503, a variable length coding means 504, a 
dequantizing means 505, an inverse DCT means 506, a 
motion compensating means 507, a frame memory 
508, an MB information coding means 509, and an 
40 upper layer information coding means 51 0. 

[0066] First the bit rate control unit 51 1 is to control 
an adjustment of a bit rate, and contains a quantizing 
parameter output means 512 and an MB bit allocating 
means 51 3 corresponding to an allocation means. Sub- 
45 sequently, the bit rate adjusting method executed in the 
bit rate control unit 51 1 will now be explained more in 
detail. Since both an input bit rate and an output bit rate 
are coded by way of different image coding systems, 
normally, the input/output bit streams own different bit 
so rates from each other in order to reproduce the com- 
pletely same image qualities of these input bit stream 
and output bit stream. The causes of these different bit 
rates may be conceived based upon, for instance, a dif- 
ference in layer structures; a difference in total numbers 
55 of information belonging to the same layers: a difference 
in bit lengths to be allocated even in the same informa- 
tion; a difference in quantizing methods; and a differ- 
ence in variable length coding methods. However, since 
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such an image coding system converting apparatus and 
an image coding system converting method are 
required which can output a bit stream having such a bit 
rate equal to an input bit stream even when an image 
coding system is changed, the bit rate control unit 51 1 is 
employed so as to absorb a difference in these bit rates. 
[0067] Also, the bit rate control unit 511 internally 
employs a register (not shown) capable of temporarily 
saving added information which is read out from the 
added information buffer 105 f Further, the bit rate con- 
trol unit 51 1 separately contains a memory in addition to 
this register, by which a bit amount of previously-coded 
picture and a compression ratio between encoders can 
be saved. A compression ratio corresponds to a bit 
amount ratio of compression image data to non-com- 
pression image data when an image of a constant 
image quality is coded. Although a compression ratio is 
varied every sample of an image, an average value 
which is calculated by way of a statistical manner may 
be utilized. It should also be understood that a compres- 
sion ratio may be influenced by a quantizing parameter, 
and when the quantizing parameter becomes large, the 
compression ratio is increased. 

[0068] Also, a compression ratio differs from each 
other, depending upon a coding system. As a result, 
when the image coding system converting apparatus 
according to this first embodiment mode is initialized, 
both the compression ratio of the image coding system 
for the input bit stream and the compression ratio of the 
image coding system for the output bit stream are 
stored from an external source via an encoder control 
means (not shown) into the memory of the bit rate con- 
trol unit 51 1 . This bit rate control unit 51 1 calculates a 
transform coefficient required in the image coding sys- 
tem conversion based on these stored compression 
ratios, and then saves the calculated transform coeffi- 
cient into the memory. 

[0069] For instance, when the compression ratio of 
the ITU-T recommendation H.261 is 1/a and the com- 
pression ratio of the MPEG-4 is 1/b, the transform coef- 
ficient required in the image coding system conversion 
from the input bit stream of the recommendation H.261 
to the output bit stream of the MPEG-4 becomes b/a. 
Conversely, the transform coefficient-required in the 
image coding system conversion from the input bit 
stream of the MPEG-4 to the output bit stream of the 
recommendation H.261 becomes a/b. 
[0070] Now, a description will be made of a first bit 
rate adjusting method executed by the bit rate control 
unit 51 1 . The bit rate control unit 51 1 reads a total bit 
"Picbft-amount" of 1 picture from the added information 
buffer 105 before the coding operation of 1 picture is 
commenced, and calculates a target bit amount based 
upon this read total bit "Picbit-amount" when this 1 pic- 
ture is decoded. At this time, this target bit amount is set 
to be larger than the read total bit "Picbft-amount" in the 
case that the bit amount of the past picture is smaller 
than the target bit amount of this picture. Conversely, 



when the bit amount of the past picture is larger than the 
target bit amount of this picture, this target bit amount is 
set to be smaller than the read total bit "Picbrt-amount" 
[0071] Also, the MB bit allocating means 513 
5 employed in the bit rate control unit 51 1 "allocates a tar- 
get bit amount of a subject picture to each of these mac- 
roblocks, and acquires a target bit amount of each of the 
macroblocks. Next, the MB bit allocating means 513 
supplies the target bit amount of each of the macrob- 
10 locks as an upper limit bit amount of the macroblock to 
the variable length coding means 504. On the other, the 
quantizing parameter output means 512 employed in 
the bit rate control unit 511 reads out the quantizing 
parameter "Quant" saved in the register, and then multi- 
is plies this value by the transform coeff icient related to the 
image coding system transform to obtain a quantizing 
parameter which will be then supplied to the quantizing 
means 503. 

[0072] Next, a description will now be made c? a 

20 second bit rate adjusting method executed by the bit 
rate control unit 511. In this second bit rate adjusting 
method, when the MB bit allocating means 513 allo- 
cates a bit this MB bit allocating means 513 reads out a 
total bit "MBbrt-amourrt" of 1 macrobit contained in the 

25 added information saved in the register employed in the 
bit rate control unit 51 1 . and then sets an upper limit bit 
amount of this 1 macrobit based on this read total bit 
value while the target bit amount of the picture is not 
used. Thus, the MB bit allocating means 513 supplies 

30 this ipper limit bit amount to the variable length coding 
means 504. On the other hand, the quantizing parame- 
ter output means 512 reads out the quantizing parame- 
ter "Quant" contained in the added information from the 
register, and then multiplies this quantizing parameter 

35 by the transform coefficient related to the image coding 
system transform. 

[0073] Subsequently, a description will now be 
made of another quantizing parameter determining 
method executed by the quantizing parameter output 

40 means 512. In Fig. 6(a), there are shown a DCT coeffi- 
cient "A" obtained by quantizing an input bit stream, and 
adequantizing DCT coefficient "B" obtained by dequan- 
tizing this DCT coefficient "A". For example, in such a 
case that the quantizing parameter is equal to 5 and the 

45 quantized DCT coefficients "A" are equal to [16, 5. 2, 3] 
from the left side, the dequantized DCT coefficients "B" 
are equal to [80. 25, 10, 15] (B = Ax5) from the left 
side. When this DCT coefficient "ET is quantized by the 
quantizing parameter 5, the quantizing error becomes 

so 0. However, as previously explained, the bit rate is 
changed, due to the difference between the compres-. 
sion ratios of the coding systems. 
[0074] As a consequence, as indicated in Fig. 6(b), 
the transform coefficient related to the image coding 

55 system transform is multiplied by the previously 
explained quantizing parameter so as to determine a 
quantizing parameter which is requantized. In this case, 
assuming now that the transform coefficient is equal to 
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1.4, since the quantizing parameter to be requarrtized 
becomes 7( = 5 x 1 .4), if the DCT coefficient "B" [80. 25. 
10. 15] is again quantized, or requarrtized by using this 
quantizing parameter 7, a DCT coefficient "C" [11. 3. 1. 
2) (C = B/7). However, while the DCT coefficient 
becomes small, if the DCT coefficient "C" is dequan- 
tized, then the dequantized DCT coefficient "D" 
becomes [77, 21, 7. 14] (D = C x7). As a result, a 
quantizing error x ( = B - D ) such as [3, 4, 3, 1] would 
be produced. 

[0075] To the contrary, as shown in Fig. 6(c). while 
using a multiplier of the original quantizing parameter 5. 
for instance, twice value thereof, namely 10 is employed 
as the quantizing parameter tar requantizing operation, 
when the DCT coefficient "B" [80, 25, 10, 15] is again 
quantized, then a DCT coefficient "E" becomes [8, 2. 1, 
1] (E = B/10 ). When this DCT coefficient "E" is dequan- 
tized, a dequantized DCT coefficient T becomes [80, 
20, 10, 10] (F = Ex10) and a quantizing error "Y" 
becomes [0. 5, 0, 5] ( Y = B - F ). As previously 
explained, when the quantizing parameter is equal to 
10, the quantized DCT coefficient (E) becomes small, 
and furthermore the accumulated value of the quantiz- 
ing errors becomes "10". namely small, as compared 
with the previous case that when the quantizing param- 
eter is equal to 7. the accumulated value of the quantiz- 
ing errors becomes 11 (see Fig. 6(b)). 
[0076] As explained above, there are some possi- 
bilities that the quantizing error may be influenced by 
the value of the DCT coefficient. However, when the 
transform coefficient is larger than 1. such a quantizing 
parameter (10) which corresponds to the multiplication 
of the original quantizing parameter (5) can increase the 
coefficient (0) of the quantizing error, as compared with 
the quantizing parameter (7) obtained by being multi- 
plied by the transform efficient As a consequence, 
when the transform coefficient is larger than 1, if the 
multiplication of the original quantizing parameter is 
equal to the actual quantizing value, then the accumu- 
lated value of the quantizing errors can be reduced. To 
the contrary, when the transform coefficient is smaller 
than 1, since the divisor of the original quantizing 
parameter is used as the actual quantizing value, the 
coefficient "0" of the quantizing error can be increased. 
Accordingly, the accumulated value of the quantizing 
errors can be reduced. 

[0077] When the macroblock is the inter type mac- 
roblock, the subtracter 501 calculates a subtraction 
between the predicted macroblock obtained from the 
motion compensating means 507 and the macroblock 
read out from the data butter 1 04 so as to produce a dif- 
ferential macroblock. Also, the DCT means 502 DCT- 
transforms the differential macroblock obtained from the 
subtracter 501. The quantizing means 503 quantizes 
the DCT-transformed differential macroblock based 
upon the quantizing parameter obtained from the quan- 
tizing parameter output means 512 employed in the bit 
rate control unit 511. 



[0078] Also, the variable length coding means 504 
variable-length -codes such a macroblock which has 
been DCT-transformed and quantized / is quantized 
with reference to the upper limit bit amount obtained 

5 from the MB bit allocating means 513 employed in the 
bit rate control unit 51 1 . It should be noted that when the 
bit amount of the variable-length-coded macroblock 
exceeds the upper limit bit amount, the variable length 
coding means 504 performs the variable length coding 

10 operation after the DCT coefficient of the rear half block 
portion (high frequency component) of the macroblock 
is replaced by "0" so as to cut the bit 
[0079] Referring now to Fig. 7, the bit cut process 
operation by the variable length coding means 504 will 

is now be explained more in detail. Fig. 7 represents an 
example of the variable length coding operation 
employed in the ITU-T recommendation H.261 and the 
like. More specifically, Fig. 7(a) shows a quantized DCT 
block, and Fig. 7(b) indicates a DCT block obtained after 

20 the bit cut process operation has been carried out First, 
as indicated by an arrow, the DCT block is variable- 
length-coded in such a manner that the DCT coeffi- 
cients are scanned in the zig-zag manner from the 
upper left DCT coefficient to the lower right DCT coeffi- 

25 cient and then these zig-zag-scanned DCT coefficients 
are rearranged to form a one-dimensional coefficient 
series. When the zig-zag-scanning operation is per- 
formed with respect to the DCT blocks, one-dimensional 
data obtained when the DCT coefficients are rear- 

30 ranged in one dimensional manner corresponds to a 
combination between a quantity "run" and a value 
"level" of DCT coefficients (except for 0) to be scanned. 
The quantity "run" indicates such a fact that how many 
DCT coefficients of "0" are continuously located in front 

35 of the DCT coefficients to be scanned. A symbol "EOB 
(End Of Block)" is added as a scanning stop code, sub- 
sequent to the last non-zero DCT coefficient It should 
be noted that in the MPEG-4, a three-dimensional vari- 
able coding operation is carried out while using another 

40 code "last" in addition to the above-described codes 
"run" and "level". This new code "last" indicates as to 
whether or not the DCT coefficient is equal to the last 
non-zero DCT coefficient among this DCT block. 
[0030] Upon receipt of the target bit amount of the 

45 macroblock from the MB bit allocating means 51 owned 
in the bit rate control unit 51 1 , the variable length coding 
means 504 divides this received target bit amount by a 
total number of blocks contained in one macroblock so 
as to calculate a target bit amount per 1 block. Next, the 

so DCT blocks are scanned in the zig-zag manner by the 
variable length coding means 504 so as to variable- 
length-code the DCT coefficients. At the same time, this 
variable length coding means 504 counts the coding 
bits. When the coding bit amount becomes equal to the 

55 target bit amount of the block, or exceeds over this tar- 
get bit amount, the variable length coding operation is 
ended to add the code "EOB". Otherwise, in the case of 
MPEG-4, the code "last" is set to 1 . 
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[0081] For instance, while the DCT block shown in 
Fig. 7(a) is variable-length -coded, when the coding bit 
amount is reached to the target bit amount at the place 
where the value of the DCT coefficient is equal to "-5", 
as indicated in Fig. 7(b), all of the DCI coefficients sub- 
sequent to the DCT coefficient of "-5" may obtain the 
similar result to that obtained when all of the DCT block 
having zero values are coded. AS explained above, 
since the variable length coding means 504 cut the bit 
by using the target bit amount of the macroblock during 
the variable length coding operation, the coding opera- 
tion can be carried out at the same bit rate as that of the 
input bit stream. 

[0082] Also, the dequantizing means 505 dequan- 
tizes the macroblock, and the inverse-DCT means 506 
inverse- DCT-transforms the macroblock dequantized by 
the inverse-quantizing means 505. Also, the frame 
memory 508 sequentially stores thereinto the dequan- 
tized/inverse-DCT-transformed macroblocks to be 
stored as the frame. These macroblocks are sent to the 
motion compensating means 507. 
[0083] Then, the motion compensating means 507 
predicts motion in response to the type of the macrob- 
lock supplied from the inverse DCT means 506 in order 
to compensate for the motion. Concrete speaking, in 
such a case that the macroblock sent from the inverse 
DCT means 506 corresponds to the inter type macrob- 
lock, the motion compensating means 507 predicts the 
motion of the subject macroblock to detect the motion 
vector, and acquires a predicted macroblock from a pic- 
ture of one-preceding frame stored in the frame memory 
508 based upon this detected motion vector. After this 
predicted macroblock has been acquired, the motion 
compensating means 507 sends this predicted macrob- 
lock to the subtracter 501. On the other hand, this 
motion compensating means 507 adds the differential 
macroblock to the predicted macroblock. and thereafter, 
writes the added macroblock into the memory position 
of the present macroblock saved in the frame memory 
508. Also, when the macroblock sent from the inverse 
DCT means 506 is the intra type macroblock. the motion 
compensating means 507 writes the dequan- 
tized/inverse-DCT-transformed macroblock into the 
memory position of the present macroblock saved in the 
frame memory 508. 

[0084] Also, the MB information coding means 509 
codes the information specific to each of the macrob- 
locks, for example, the type of macroblock and the 
motion vector with respect to the macroblock coded by 
the variable length coding means 504. and then sends 
the coded information to the upper layer information 
coding means 510. 

[0085] Also, the upper layer information coding 
means 510 reads out the time information Time-info" 
from the added information buffer 105, and codes the 
layer information of the layer higher than, or equal to the 
picture layer among the layers for constituting the 
motion picture bit stream sequence with respect to the 



coded information which is supplied from the MB infor- 
mation coding means 509. 

[0086] Next, referring now to Fig. 8, an explanation 
will be made of the coding (encoding) process opera- 

s tion, according to this first embodiment mode, executed 
by the encoder unit 106 having these structural ele- 
ments. Fig. 8 is a flow chart for describing the coding 
process operation executed by the encoder unit 106. At 
a first step S201 , the bit rate control unit 51 1 reads out 

10 "Picb it-amount" from the added information buffer 105, 
and then saves this bit amount to the internal register 
thereof (not shown). At the next step S202, the encoder 
control means (not shown) reads out "MB-coded" from 
the added information buffer 105, and then sends the 

is coded information of the respective blocks of the mac- 
roblock to the MB information coding means 509. Now, 
when no coding process operation is required for all of 
the blocks, the data stored at the position of the present 
macroblock of 1 -preceding frame is copied from the 

20 frame memory 508 to the storage position of the 
present macroblock within the frame memory 508. 
[0087] Next, at a step S203. the encoder control 
means reads "MB-type" from the added information 
buffer 105, and checks as to whether the type of mac- 

25 roblock corresponds to the Intra" type macroblock or 
the "inter" type macroblock. When this macroblock cor- 
responds to the intra type macroblock, this decoding 
process is advanced to a step S204, whereas when this 
macroblock corresponds to the inter type macroblock, 

30 this decoding process is advanced to a step S205. At 
the step S204 (intra type macroblock), the bit rate con- 
trol unit 51 1 reads out "MBbit-amourrr from the added 
information buffer 1 05, and then saves this bit amount to 
the internal register (not shown). At this time, the MB bit 

35 allocating means 513 provided in the bit rate control unit 
51 1 calculates an upper limit bit amount to be allocated 
to the present macroblock based upon "Picbrt-amount" , 
"MBbit-amourrr, and the present coding bit amount, 
and the like, and then sends this upper limit bit amount 

40 to the variable length coding means 504. The variable 
length coding means 504 variable-length-codes the 
macroblock read from the data buffer 104. At this time, 
when the bit amount of the variable-length-coded mac- 
roblock exceeds this calculated upper limit bit amount. 

45 the variable length coding means 504 replaces the DCT 
coefficient of the rear half block portion (high frequency 
component) of the macroblock by "0" so as to cut the 
bits, and thereafter variable-length-codes the cut mac- 
roblock. 

so [0088] On the other hand, at the step S205 (inter 
type macroblock). the motion compensating means 507 
detects the motion vector by predicting the motion of the 
macroblock read from the data buffer 104. and thereaf- 
ter acquires the predicted macroblock based upon this 

55 motion vector, and then supplies this acquired predicted 
macroblock to the subtracter 501. The subtracter 501 
calculates a difference between the predicted macrob- 
lock supplied thereto and the macroblock read out from 
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the data buffer 104 by the encoder control means so as 
to obtain a differential macrobiock, and then sends the 
calculated differential macrobiock to the DCT means 
502. 

[0089] Next, at a step S206, the DCT means 502 
DCT-transforms the differential macrobiock, and then 
supplies the DCT-transformed differential macrobiock to 
the quantizing means 503. Next, at a step S207, the bit 
rate control unit 511 reads out both "MB-bit amount" 
and "Quant" from the added information buffer 105 to 
save these read information into the internal register 
(not shown). Subsequently, the quantizing parameter 
output means 512 employed in the bit rate control unit 
51 1 determines the quantizing parameter of the present 
macrobiock based upon "Picb'rt-amount". "MBbit- 
amount", and the present coding bit amount. 
[0090] Next, at a step S208, the quantizing means 
503 quantizes the DCT coefficient by using the quantiz- 
ing parameter determined by the quantizing parameter 
output means 512. Next, the variable length coding 
means 504 variable-length-codes the macrobiock quan- 
tized by the quantizing means 503. At this time, when 
the coded bit amount of the variable-length-coded differ- 
ential macrobiock exceeds this calculated upper limit bit 
amount, the variable length coding means 504 replaces 
the DCT coefficient of the rear half block portion (high 
frequency component) of the macrobiock by "0" so as to 
cut the bits, and thereafter variable-length-codes the cut 
macrobiock 

[0091] When the process operation defined at the 
step S204, or the step S208 is completed, the decoding 
process operation is advanced to a step S209. At this 
step S209, the MB information coding means 509 adds 
the MB information such as the type of macrobiock and 
the motion vector to the differential macrobiock coded 
by the variable coding means 504, and then supplies 
the MB information-added differential macrobiock to the 
upper layer information coding means 51 0. 
[0092] Next, at a step S210, the macrobiock which 
has been DCT-transformed and quantized is dequan- 
tized by the dequantizing means 505 and is irrverse- 
DCT-transformed by the inverse DCT means 506, and 
thereafter, the resulting macrobiock is sent to the motion 
compensating means 507. Next, when the supplied 
macrobiock corresponds to the intra type macrobiock, 
the motion compensating means 507 writes such a 
macrobiock which is dequantized and inverse-DCT- 
transformed into the position of the present macrobiock 
within the frame memory 508. On the other hand, when 
the supplied macrobiock corresponds to the inter type 
macrobiock. the motion compensating means 507 
reads out the predicted macrobiock from the picture of 
1 -preceding frame stored in the frame memory 508. and 
then adds the differential macrobiock to this predicted 
macrobiock thereafter, this motion compensating 
means 507 writes the added macrobiock into the posi- 
tion of the present macrobiock within the frame memory 
508. 



[0093] Next at a step S21 1 , a check is made as to 
whether or not the present macrobiock corresponds to a 
first macrobiock within the picture. When the present 
macrobiock is equal to the f irst macrobiock, the coding 
> process operation is advanced to a step S212. When 
the present macrobiock is not equal to the first macrob- 
iock and a last macrobiock, the coding process opera- 
tion is advanced to a step S213. At the step S212, the 
upper layer information coding means 510 reads out 
to Time-info" from the added information buffer 105. and 
adds the upper layer information to the bit stream of the 
macrobiock supplied from the MB information coding 
means 509. and then outputs the bit stream added with 
the upper layer information to the output means 107. 
15 This upper layer information is time information indica- 
tive of the start codes of the respective layers and the 
decoding timing of the picture. Thereafter, the coding 
process operation is returned to the previous step S202 
at which the coding process operation is carried out for 
20 the next macrobiock. 

[0094] At the step S213. a check is made as to 
whether or not the present macrobiock corresponds to 
the last macrobiock within the picture. When the present 
macrobiock is not equal to the last macrobiock, the 
25 upper layer information coding means 510 directly sup- 
plies the bit stream of the macrobiock sent from the MB 
information coding means 509 to the output means 1 07. 
Then, the coding process operation is returned to the 
step S202. To the contrary, when the present macrob- 
30 lock is equal to the last macrobiock, the coding process 
operation is advanced to a step S214. At this step S214. 
a check is done as to whether or not the present frame 
corresponds to the last picture. When the present frame 
is not equal to the last picture, the upper layer infbrma- 
35 tion coding means 51 0 directly supplies the bit stream of 
the macrobiock sent from the MB information coding 
means 509 to the output means 107. Then, the coding 
process operation is returned to the step S201. To the 
contrary, when the present frame is equal to the last pic- 
40 ture. the coding process operation is accomplished. 
[0095] As previously explained in detail, in accord- 
ance with the image coding system converting appara- 
tus and the image coding system converting method of 
this first embodiment mode, while the decoder unit 103 
45 performs the decoding operation, the added information 
containing the macrobiock type "MB-type" is written into 
the added information buffer 105. In the case that the 
encoder unit 106 encodes such a frame that the intra 
type macroblocks are mixed with the inter type macrob- 
so locks, the motion compensating means 507 judges as 
to whether the macrobiock corresponds to the intra type 
macrobiock. or the inter type macrobiock with reference 
to the macrobiock type "MB-type" contained in the 
added information read from the added information 
55 buffer 105. As a result, when the macrobiock corre- 
sponds to the intra type macrobiock, in the encoder unit 
106. both the DCT process operation and the quantizing 
process operation can be omitted. Also, both the 
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dequantizing process operation and the inverse DCT 
process operation can be omitted in the decoder unit 
103. 

[0096] As a consequence, there is completely no 
deterioration in the image quality, or the deterioration in 
the image quality can be suppressed to the minimum 
value, as compared with the coding/decoding opera- 
tions executed only for the image data. Also, since the 
calculation load related to the image coding system 
converting operation (tor example, calculation required 
to adjust coded bit rate) can be reduced, it is possible to 
convert the image coding systems in a high speed. 
[0097] Furthermore, as to the intra type macrob- 
lock, since the quantizing parameters equal to each 
other in the input bit stream and the output bit stream 
are employed, the image quality of the input bit stream 
can be completely reproduced under such a condition 
that there is no quantizing error in the encoder unit 106. 
[0098] Also, when the inverse DCT transforming 
operation is not carried out, the data saved in the data 
buffer 104 corresponds to the non-compression image 
data. Then, since this non-compression image data is 
motion-compensated by the encoder unit 106, the 
image quality of the subject macroblock is better. To the 
contrary, when the inverse DCT transforming operation 
is carried out, the data saved in the data buffer 104 is 
the DCT coefficient of the differential macroblock. This 
differential macroblock is not motion-compensated by 
the encoder unit 1 06, but the same motion vector is also 
employed. At this time, when the predicted macroblock 
acquired in the encoder unit 106 is completely identical 
to the subject macroblock, the image quality of the sub- 
ject macroblock is not completely deteriorated. H not 
then the image quality is more or less deteriorated. 
[0099] Next, a description will now be made of, in 
particular, an embodiment related to the operation of 
the encoder unit 1 06 employed in the image coding sys- 
tem converting apparatus according to this first embod- 
iment mode. 

(First Embodiment) 

[0100] In a first embodiment, as shown in Fig. 9(a), 
the encoder unit 106 does not perform both the DCT 
transforming operation and the quantizing operation 
irrespective to a type of a macroblock. When the varia- 
ble-length-coding operation is carried out, the variable 
length coding means 504 cuts a bit of a macroblock 
based upon such a bit allocation map as shown in Fig. 
9(b). This bit allocation map is formed by using the 
upper limit bit amounts of the respective macroblocks 
obtained from the MB bit allocating means 513. It 
should be understood in this embodiment that as to an 
intra type macroblock, the ipper limit bit amount having 
the same value for the inter type macroblock is allo- 
cated, or while no such an upper limit bit amount is set 
the bit cut operation is not completely carried out 
[0101] In this first embodiment, neither the quantiz- 



ing operation, nor the DCT transforming operation are 
completely carried out as to both the intra type macrob- 
lock and the inter type macroblock in the stage for con- 
verting the image coding systems. As a result, the 
5 calculation amount can be largely reduced and also the 
image coding systems can be converted in a high 
speed. 

(Second Embodiment) 

10 

[0102] Then, as shown in Fig. 10(a), in a second 
embodiment, a quantized DCT coefficient is directly 
used to an intra type macroblock, whereas as to an inter 
type macroblock, as previously explained, in the quan- 
15 tizing parameter output means 51 2, either the divisor of 
the original quantizing parameter or the multiplication of 
this original quantizing parameter is used as the actual 
quantizing value in response to the transform coefficient 
caused by a difference in the compression ratios. 
20 [0103] However, as shown in Fig. 10(b), there are 
some possibilities that such a quantizing value 
becomes smaller than the original quantizing parame- 
ter. This quantizing value is obtained by calculating 
such a quantizing value by way of the round-up number- 
25 ing method, which may becomes a mixed decimal 
obtained by multiplexing the original quantizing parame- 
ter by this transform coefficient. For instance, as indi- 
cated in Fig. 11(b). when the DCT coefficient 13 after 
the original quantizing operation is dequantized by 
30 using the quantizing parameter 8, this DCT coefficient 
becomes 104. When this DCT coefficient is requantized 
by using the quantizing parameter 5, the requantized 
DCT coefficient becomes 20. When this DCT coefficient 
is again dequantized, the resulting DCT coefficient 
35 becomes 100. 

[0104] As previously explained, when the DCT 
coefficient which is requantized by using the different 
quantizing parameters is decreased (namely, from 104 
to 110), the image quality would be deteriorated. As a 
40 result, as to the DCT coefficient of the macroblock to 
which such a case is applied, as indicated in Fig. 1 1 (a), 
the original DCT coefficient is kept remained. When the 
DCT coefficient is increased by being requantized, the 
obtained DCT coefficient may be directly employed. 
45 [0105] The transform coefficient may be, as 
explained above, determined based upon the ratio of 
the compression ratio of the image coding system for 
the input bit stream to that of the image cocfing system 
for the output bit stream. Alternatively, this transform 
so coefficient may be determined every picture by using a 
ratio of the target bit to the total bit "Picbit-amounr of 1 _ 
picture read out from the added information buffer 105. 
[01 06] As shown in Fig. 1 2, while such a conversion 
table is previously formed, the transform coefficient may 
55 be determined based upon this conversion table. In this 
conversion table, the original quantizing parameters 
and the transform coefficients are made in correspond- 
ence with each other every converting type from the 
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input bit stream to the output bit stream, for instance, 
H.261 to MPEG-4 and MPEG-4 to H.261 . 
[0107] In this second embodiment neither the 
quantizing operation, nor the DCT transforming opera- 
tion are completely carried out as to the intra type mac- s 
roblock in the stage for converting the image coding 
systems. As a result the calculation amount can be 
largely reduced. It should also be noted that since either 
the quantizing operation or both the quantizing opera- 
tion and the DCT operation are carried out as to the 10 
inter type macroblock, the system converting operation 
can be carried out in a high speed while suppressing 
the deterioration in the image quality. 

[SECOND EMBODIMENT MODE] is 

[0108] Fig. 13 is a block diagram for schematically 
indicating an arrangement of an image coding system 
converting apparatus according to a second embodi- 
ment mode of the present invention. It should be under- 20 
stood that the sane reference numerals shown in Fig. 1 
(namely first embodiment mode) will be employed as 
those for denoting the same, or similar means of thus 
second embodiment mode indicated in Fig. 13. In Fig. 
13, an image coding system converting apparatus 900, 25 
according to this second embodiment mode, is 
arranged by employing input means 902, a decoder unit 
903. a data buffer 904, an added information buffer 905, 
an encoder unit 906, and output means 107 similar to 
that of the first embodiment mode. 30 
[0109] First, different from the input means 102 of 
the f irst embodiment mode, the input means 902 of this 
second embodiment mode can store input bit streams 
for plural frames into an internal bit buffer thereof (not 
shown). The decoder unit 903 can decode the input bit 35 
streams for several frames prior to the encoding proc- 
ess operation by the encoder unit 906, and can store 
either the decoded image data or the data decoded in a 
half yvay into the data buffer 904, and also can store the 
added information into the added information buffer 40 
905. 

[0110] Also, a data storage capacity of the data 
buffer 904 and a data storage capacity of the added 
information buffer 905 are several times larger than 
those of the data buffer 104 and the added information 45 
buffer 105 according to the first embodiment mode. Fur- 
thermore, the encoder unit 906 executes the encoding 
operation by referring to both added information of a 
subject frame saved in the added information buffer 
905, and added information of a backward (future) so 
frame which is time-sequentially located subsequent to 
the added information of this subject frame. 
[0111] Next, a description will now be made of an 
encoding operation executed by the encoder unit 905 in 
such a case that the image coding system converting ss 
apparatus 900 of this second embodiment mode con- 
verts coding systems from either MPEG-4 or ITU-T rec- 
ommendation H.261 to either the ITU-T 



recommendation H.261 or the MPEG-4. Generally 
speaking, since the compression ratio of the MPEG-4 is 
higher than that of the ITU-T recommendation H.261, 
the transform coefficient used in the image coding sys- 
tem converting operation from the MPEG-4 to the rec- 
ommendation H.261 becomes larger than 1. At this 
time, in accordance with the first embodiment mode, the 
bit allocation is carried out with reference to the upper 
limit bit value (see Fig. 9, namely first embodiment 
mode), the actual quantizing parameter of the inter type 
macroblock is made by multiplying the original quantiz- 
ing parameter by 2 (see Fig. 10, namely second embod- 
iment mode), or the quantizing parameter is changed by 
using the conversion table (see Fig. 12, namely second 
embodiment mode). As a consequence, the errors 
would be uniformly distributed to the entire frame. 
[0112] Therefore, in accordance with this second 
embodiment mode, when an actual quantizing parame- 
ter of a subject macroblock is determined, as indicated 
in Fig. 14, the quantized DCT coefficient is directly used 
to both an intra type macroblock and the below-men- 
tioned macroblock (corresponding to an empty macrob- 
lock shown in Fig. 14) by referring to a type of such a 
macroblock located at the same position of the subject 
macroblock of the time-sequentially backward (future) 
frame. That is, this empty macroblock is an inter type 
macroblock in a preselected number of frames, but will 
become an intra type macroblock after several frames 
(will be referred to "macroblock is refreshed" hereinaf- 
ter). On the other hand, the quantizing parameter is 
changed with respect to such an inter type macroblock 
which is not refreshed. 

[01 1 3] Also, as a method for determining a macrob- 
lock used to change a quantizing parameter, in addition 
to the above-explained method for previously reading 
the future frame, an activity indicative of a difficulty 
degree of coding operation may be obtained by multiply- 
ing a code bit amount of a macroblock by a quantizing 
parameter. Then, the macroblock determining method 
may be employed based upon the acquired activity. 
Also, when such an algorithm is employed in which 
since a macroblock whose activity is large is a fine 
image, this fine image may be more, or less deterio- 
rated, the quantized DCT coefficient may be directly 
used with respect to this macroblock, whereas the 
quantizing parameter may be changed with respect to 
another macroblock whose activity is small. 
[0114] It should be noted that as to an inter type 
macroblock to be refreshed, the quantized DCT coeffi- 
cient may be directly used, or may not be used, while 
the quantizing parameter may be used as the same 
value parameter. When such a transform coefficient is 
directly used which is multiplied with the quantizing 
parameter of the inter type macroblock to be refreshed, 
the bit rate of the output bit stream becomes excessively 
high, so that the transform coefficient must be adjusted 
in accordance with a total number of macroblocks 
whose quantizing parameters are changed. 
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[0115] Next, a description will new be made of 
encoding operation executed by the encoder unit 906 in 
such a case that the image coding system converting 
apparatus 900 according to this second embodiment 
mode converts the coding system from the recommen- 
dation H.261 to the MPEG-4. In this recommendation 
H.261 , a value defined from 1 to 31 may be freely used 
as the quantizing parameter of the rnacroblock How- 
ever, in the MPEG-4, there is such a limitation that the 
quantizing parameter between the adjoining macrob- 
locks must be smaller than, or equal to ± 2. As a conse- 
quence, the quantizing parameter utilized in the 
rnacroblock of the recommendation H.261 cannot be 
directly used. For instance, in such a case that the 
quantizing parameter 5 is employed in a certain rnac- 
roblock of the recommendation H.261 and also the 
quantizing parameter 10 is employed in another rnac- 
roblock located adjacent to this rnacroblock, when the 
image coding system converting apparatus 900 con- 
verts the coding system from the recommendation 
H.261 to the MPEG-4. the quantizing parameter of the 
adjoining rnacroblock cannot be increased up to 7. 
[01 16] A graphic representation shown in Fig. 1 5(a) 
represents an example of a quantizing parameter used 
in the ITU-T recommendation H.261. An abscissa 
shows a rnacroblock number (MB) number, and an ordi- 
nate indicates the employed quantizing parameter. The 
quantizing parameter is given as [5. 5. 10. 12. 12. 8, 6, 
51 in this order. Also, Fig. 15(b) shows an example of a 
quantizing parameter employed when a coding opera- 
tion is carried out in the MPEG-4. It is now assumed that 
the rnacroblock having the MB number shown in the 
drawing corresponds to either an intra type rnacroblock 
or an inter type rnacroblock to be refreshed, and thus, 
changing of the quantizing parameter is not required. 
[0117] As previously explained, the MPEG-4 owns 
such a limitation that the quantizing parameter between 
the adjoining macroblocks must be smaller than, or 
equal to ±2. As a consequence, when the quantizing 
parameter is adjusted in accordance with the below- 
mentioned algorithm, the adjusted quantizing parame- 
ter (a) is given as [5. 5. 7. 9, 11, 9. 7, 5]. In this algo- 
rithm, when the quantizing parameter is increased, the 
quantizing parameter is increased by either 1 or 2, 
whereas when the quantizing parameter is decreased, 
the quantizing parameter is decreased by either 1 or 2. 
[01 1 8] To the contrary, when the quantizing param- 
eter is prior-read, it is known such a fact that the quan- 
tizing parameter is decreased by the MB numbers 6. 7, 
8. Assuming now that while the quantizing parameter is 
not increased up to 11, but up to 10, the quantizing 
parameter (b) is given as [5, 5. 7, 9, 1 0, 8. 6. 5]. as to the 
quantizing parameter (a), a total number of MB num- 
bers different from the quantizing parameter which is 
employed in the recommendation H.261 becomes 5 
(namely MB numbers of 3. 4, 5, 6. 7), whereas as to the 
quantizing parameter (b), a total number of MB num- 
bers becomes 3 (namely MB numbers of 3, 4, 5). As 



explained above, the number of such macroblocks in 
which the image qualities are deteriorated can be sup- 
pressed in such a manner that the quantizing parameter 
of the rnacroblock is prior-read so as to 

5 increase/decrease the optimum quantizing parameter. 
[0119] Next, a description will now be made of 
another encoding operation executed by the encoder 
unit 906 in such a case that the image coding system 
converting apparatus 900 according to this second 

io embodiment mode converts the coding system from the 
recommendation H.261 to the MPEG-4. As previously 
explained, in the MPEG-4. there is such a limitation that 
the difference contained in the quantizing parameters 
between the adjoining macroblocks must be smaller 

15 than, or equal to ± 2. When a new quantizing parameter 
is wanted to be increased larger than, or equal to ±3, the 
below-mentioned "vpacket" system is employed. This 
"vpacket" system is illustrated in Fig. 16. That is, while 
macroblocks contained in a frame are sequentially 

20 scanned from an upper left corner to a right direction, a 
plurality of areas are formed within 1 frame by using two 
sets of continuous macroblocks whose quantizing 
parameters are largely made different from each other. 
Thus, these areas are recognized as "vpacket*'. As a 

25 consequence, a "vpacket" is constituted by at least one 
rnacroblock. and rnacroblock which constitute one 
vpacket are not dispersed. 

[0120] In the example of Fig. 15. the quantizing 
parameter is adjusted by prior-reading the macroblocks. 

30 However, since such a vpacket is utilized, the rnacrob- 
lock is no longer prior-read. Accordingly, the calculating 
process amount required for prior-reading the rnacrob- 
lock can be reduced in the example of Fig. 16. Also, 
since the quantizing parameter is not changed, the 

35 quantizing error can be reduced. 

[0121] It should be noted that the non-linear quan- 
tizing operation is carried out with respect to the DC 
(direct current) coefficient in the blocks within the intra 
type rnacroblock in the MPEG-4. As a result, the same 

40 quantizing parameters cannot be employed as to the 
DC coefficient of the intra type block in the recommen- 
dation H.261 and the MPEG-4. As a consequence, the 
DC coefficient is required to be dequantized by the 
dequantizing means employed in the decoder unit 903, 

45 and also the DC coefficient is required to be quantized 
by the quantizing means provided in the encoder unit 
906. 

[01 22] AS previously explained, in accordance with 
the image coding system converting apparatus and the 

so image coding system converting method of this second 
embodiment mode, the quantized DCT coefficient is - 
directly used for the inter type rnacroblock to be 
refreshed with reference to the added information of the 
subject frame, and the added information of the back- 

55 ward (future) frame from this subject frame. As a result, 
although the image quality of this inter type rnacroblock 
is deteriorated during several frames, the calculation 
amount related to the image coding system converting 
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operation can be reduced. 

[0123] Also, even when the image coding system is 
converted from H.261 to MPEG-4, the quantizing 
parameter can be changed by prior-reading the mac- 
roblocks in order to reduce the quantizing error. Further- 
more, since the Vpacket" is employed, the quantizing 
parameter can be directly employed with respect to 
such a macroblock that the quantizing parameter need 
not be changed without any limitation specific to the 
MPEG-4. As a consequence, the image coding system 
can be converted while suppressing the deterioration in 
the image quality. 

[0124] As previously described in detail, in the 
image coding system converting apparatus, the image 
coding system, and the recording medium, according to 
the present invention, it is featured by that the separa- 
tion means (step) separates the input data into the 
coded image data and the added information data, this 
image data is produced by coding a picture in the unit of 
a block, which owns a plurality of blocks constituted by 
a predetermined number of pixels, and the added infor- 
mation data contains data amount information of the 
picture; the decoding means (step) inverse-orthogonal- 
transforms the coded image data; the allocation means 
(step) allocates the upper limit data amount to the 
respective blocks owned by the picture based upon the 
data amount information of the picture, or sets the upper 
limit data amount of the respective blocks based upon 
the data amount information of the picture; and the cod- 
ing means (step) cuts the data of the subject block in 
such a case that the data amount of the subject block is 
larger than, or equal to the upper limit data amount set 
to the subject block, and inverse-orthogonal-transforms 
the cut data. 

[0125] As previously explained, in the decoding 
means (decoding step), only the inverse-orthogonal- 
transforming operation is performed while both the 
dequantizing operation and the inverse DCT transform- 
ing operation are not carried out, and in the coding 
means (coding step), only the orthogonal transforming 
operation is carried out while both the DCT transforming 
operation and the quantizing operation are not carried 
out As a result, the calculation amount required for con- 
verting a certain image coding system into another 
image coding system can be largely reduced. Accord- 
ingly, it is possible to provide the image coding system 
converting apparatus, the image coding system con- 
verting method, and the recording medium, by which 
the highspeed image coding system converting opera- 
tion can be realized. Also, since the data of the block is 
cut based upon the upper limit data amount, even when 
a certain image coding system is converted into another 
different image coding system, these image coding sys- 
tems can be converted at the substantially same bit rate 
as the original bit rate without giving any large adverse 
influence to the image quality. 

[0126] Also, in the image coding system converting 
apparatus, the image coding system converting 



method, and the recording medium, according to the 
present invention, it is featured by that the separation 
means (step) separates the input data into the coded 
image data and the added information data, this image 
5 data is produced by coding a picture in the unit of a 
block, which owns a plurality of blocks constituted by a 
predetermined number of pixels, and the added infor- 
mation data contains conding information of each block 
and quantizing parameter information; the block coding 
70 system judging means (step) judges the coding system 
of the subject block with reference to the coding infor- 
mation of the subject block; the decoding means (step) 
executes either the inverse-orthogonal-transform oper- 
ation and the dequantizing operation with respect to the 
75 subject block in response to such a judgement result 
made of the block coding system judging means (step); 
the coding means (step) includes the quantizing param- 
eter output means (step) for outputting a new quantizing 
parameter based upon the quantizing parameter intona- 
te tion, wherein the first coding means (step) is performed 
which orthogonal-transforms such a block which has 
been inverse-orthogonal-transformed by the decoding 
means (step) without quantizing the block; and the cod- 
ing means (step) wherein as to such a block which has 
25 been inverse-orthogonal-transformed and dequantized 
by the decoding step, after the new quantizing parame- 
ter outputted tram the quantizing parameter output 
means (step) is multiplied by the DCT coefficient of the 
block, the second coding means (step) quantizes and 
30 also orthogonal-transforms the block. 

[0127] More specifically, the block coding system 
judging means (step) judges as to whether the subject 
block corresponds to the intra-coded block, or the inter- 
coded block; and when the block coding system judging 
35 means (step) judges that the subject block corresponds 
to the intra-coded block, the decoding means (step) 
inverse-orthogonal-transforms the subject block judged 
as the intra-coded block, whereas when the block cod- 
ing system judging means (step) judges that the subject 
40 block corresponds to the inter-coded block, the decod- 
ing means (step) inverse-orthogonal-transforms and 
also dequantizes the subject block judged as the inter- 
coded block. 

[0128] As described above, since the quantized 
45 DCT coefficient is directly used for the intra-coded type 
block, both the dequantizing calculation required in the 
decoding means (decoding step), and also the quantiz- 
ing calculation required in the coding means (coding 
step) can be omitted. Accordingly, it is possible to pro- 
so vide the image coding system converting apparatus, the 
image coding system converting method, and the 
recording medium, by which the highspeed image cod- 
ing system converting operation can be realized. Also, 
as to the inter-coded type block, the new quantizing 
55 parameter is produced by multiplying the new quantiz- 
ing parameter by the DCT coefficient of this block, and 
this inter-coded type block is requantized by using this 
new quantizing parameter. Therefore, even when a cer- 
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tain image coding system is converted into another dif- Claims 
ferent image coding system, these image coding 
systems can be converted at the substantially same bit 1 . 
rate as the original bit rate without giving any large 
adverse influence to the image quality. 5 
[01 29] Also, more specifically, the block coding sys- 
tem judging means (step) judges as to whether the sub- 
ject block corresponds to the infra-coded block, or the 
inter-coded block; and when the block coding system 
judging means (step) judges that the subject block cor- 
responds to the intra-coded block, the decoding means 
(step) inverse-orthogonal-transforms the subject block 
judged as the intra-coded block, whereas when the 
block coding system judging means (step) judges that 
the subject block corresponds to the inter-coded block, 
and further judges as to whether the coding system of 
the block belonging to the frame time-sequentially suc- 
ceeded to the frame to which the subject block, and 
located at the same position of the subject block corre- 
sponds to the intra-coded block, or the inter-coded 
block; when the judged block corresponds to the intra- 
coded block, the decoding means (step) inverse-orthog- 
onal-transforms the subject block judged as the intra- 
coded block, whereas when the judged block corre- 
sponds to the intra-coded block, the decoding means 
(step) inverse-orthogonal-transforms and also dequan- 
tizes the subject block judged as the inter-coded block. 2. 
[0130] As previously explained, the quantized DCT 
coefficient is drectly employed with respect to both the 
intra-coded type block, and also such an inter-coded 30 
type block that the coded type of the block corresponds 
to the intra-coded type block, and this block is located at 
the same position as that of the subject block of such a 
frame time-sequentially subsequent to the frame to 
which the subject block belongs. As a result, the 
dequantizing calculation required in the decoding 
means (decoding step), and also the quantizing calcula- 
tion required in the coding means (coding step) can be 
omitted. Accordingly, it is possible to provide the image 
coding system converting apparatus, the image coding 
system converting method, and the recording medium, 
by which the highspeed image coding system convert- 
ing operation can be provided. Also, the blocks other 
than the above-explained block may readily cause the 
image qualities to be deteriorated while the blocks 
located at the same positions within the time-sequen- 
tially subsequent frame are such inter-coded type 
blocks. However, these blocks may become the intra- 
coded type blocks in future. Therefore, it is possible to 
realize such an image coding type converting operation 
while suppressing the deterioration in the image quali- 
ties. It should also be noted that since a total number of 
frames to be judged by the above-explained block cod- 
ing system judging step is reduced, the time duration 
when the deterioration in the image quality occurs can ss 
be shortened. 
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An image coding system converting apparatus 
comprising: 

decoding means including separation means 
which separates input data into coded image 
data and added information data, said decod- 
ing means inverse-orthogonal -transforming 
said coded image data, said image data being 
produced by coding a picture in the unit of a 
block, which owns a plurality of blocks consti- 
tuted by a predetermined number of pixels, and 
said added information data containing data 
amount information of said picture; and 
coding means including allocation means 
which allocates an upper limit data amount to 
the respective blocks owned by said picture 
based upon the data amount information of 
said picture, said coding means cutting data of 
a subject block and inverse-orthogonal-trans- 
forming the cut data in such a case that a data 
amount of said subject block is larger than, or 
equal to said upper limit data amount allocated 
to said subject block. 

An image coding system converting apparatus 
comprising: 

decoding means including separation means 
which separates input data into coded image 
data and added information data, said decod- 
ing means inverse-orthogonal-transforming 
said coded image data, said image data being 
produced by coding a picture in the unit of a 
block, which owns a plurality of blocks consti- 
tuted by a predetermined number of pixels, and 
said added information data containing data 
amount information of a plurality of blocks; and 
coding means including allocation means 
which sets an upper limit data amount of the 
respective blocks based upon the data amount 
information of the pluraGty of blocks, said cod- 
ing means cutting data of a subject block ar*d 
inverse-orthogonal-transforrning the cut data in 
such a case that a data amount of said subject 
block is larger than, or equal to said upper limit 
data amount set to said subject block. 



50 



3. An image coding system converting apparatus 
comprising: 

decoding means including: separation means 
which separates input data into coded image 
data and added information data, said image 
data being produced by coding a picture in the 
unit of a block, which owns a plurality of blocks 
constituted by a predetermined number of pix- 
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els. and said added information data containing 
coding information of each block and quantiz- 
ing parameter information; and block coding 
system judging means for judging a coding 
system of said subject block with reference to 5 
coding information of said subject block, said 
decoding means executing either an inverse- 
orthogonal-transform operation and a dequan- 
tizing operation with respect to said subject 
block in response to a judgement result made 10 
of said block coding system judging means; 
and 

cooing means including quantizing parameter 
output means for oulputting a new quantizing 
parameter based upon said quantizing param- is 
eter information, wherein: said coding means 
orthogonal-transforms such a block which has 
been inverse-orthogonal-transformed by said 
decoding means without quantizing said block, 
whereas as to such a block which has been 20 
inverse-orthogonal-transformed and dequan- 6. 
tized by said decoding means, after said new 
quantizing parameter outputted from said 
quantizing parameter output means is multi- 
plied by a DCT coefficient of said block, said 25 
coding means quantizes and also orthogonal- 
transforms said block 

An image coding system converting apparatus as 
claimed in claim 3 wherein: 30 

said block coding system judging means 
judges as to whether said subject block corre- 
sponds to an intra-coded block, or inter-coded 
block; and 35 
when said block coding system judging means 
judges that said subject block corresponds to 
the intra-coded block, said decoding means 
inverse-orthogonal-transforms said subject 
block judged as the intra-coded block, whereas 40 
when said block coding system judging means 
judges that said subject block corresponds to 
the inter-coded block, said decoding means 
inverse-orthogonal-transforms and also 
dequantizes said subject block judged as the 45 
inter-coded block. 7. 

An image coding system converting apparatus as 
claimed in claim 3 wherein: 

50 

said block coding system judging means 
judges as to whether said subject block corre- 
sponds to an intra-coded block, or inter-coded 
block; and 

when said block coding system judging means 55 
judges that said subject block corresponds to 
the intra-coded block, said decoding means 
inverse-orthogonal-transforms said subject 



block judged as the intra-coded block, whereas 
when said block coding system judging means 
judges that said subject dock corresponds to 
the inter-coded block, and further judges as to 
whether a coding system of a block belonging 
to a frame time-sequentially succeeded to the 
frame to which said subject block, and located 
at the same position of said subject block cor- 
responds to an intra-coded block, or an inter- 
coded block, 

when said judged block corresponds to the 
intra-coded block, said decoding means 
inverse-orthogonal -transforms said subject 
block judged as the intra-coded block, 
when said judged block corresponds to the 
intra-coded block, said decoding means 
inverse-orthogonal -transforms and also 
dequantizes said subject block judged as the 
inter-coded block 

An image coding system converting apparatus as 
claimed in claim 3 wherein: 

said added information contains bit amount 
information of each of said blocks; 
said block coding system judging means 
judges as to whether said subject block corre- 
sponds to an intra-coded block or inter-coded 
block and 

when said block coding system judging means 
judges that said subject block corresponds to 
the intra-coded block, said decoding means 
inverse-orthogonal-transforms said subject 
block judged as the intra-coded block whereas 
when said block coding system judging means 
judges that said subject block corresponds to 
the inter-coded block, said decoding means 
either inverse-orthogonal-transforms or 
inverse-orthogonal-transforms and also 
dequantizes said subject block judged as the 
inter-coded block based upon an activity indic- 
ative of a degree of coding difficulty which is 
acquired by multiplying the bit amount of said 
subject block by a quantizing parameter. 

An image coding system converting apparatus as 
claimed in claim 3, 4, 5, or 6 wherein: 

said coding means includes transforming -coef- 
ficient calculating means for calculating a 
transforming coefficient based upon a differ- 
ence in compression ratios before/after the 
image coding systems are converted; and 
when the transforming coefficient calculated by 
said transforming-coeff icierrt calculating means 
is larger than 1 , said quantizing parameter out- 
put means sets a new quantizing parameter as 
a multiplier indicated by said quantizing param- 
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eter information; whereas when said transform- 
ing coefficient is smaller than 1 , said quantizing 
parameter output means sets a new quantizing 
parameter as a divisor indicated by said quan- 
tizing parameter information and outputs said 5 
new quantizing parameter. 

8. An image coding system converting apparatus as 
claimed in claim 7 wherein: 

10 

said quantizing parameter output means out- 
puts said original DCT coefficient as a DOT 
coefficient as said block in such a case that 
while either the multiplier of the quantizing 
parameter or the divisor thereof indicated by is 
said quantizing parameter information is used 
as said new quantizing parameter, a DCT coef- 
ficient obtained by multiplying a DCT coeffi- 
cient of a block by said multiplier, or said divisor 
becomes smaller than the original DCT coeffi- 20 
cient 

9. An image coding system converting apparatus as 
claimed in claim 7, or 8 wherein: 

25 

said transforming coefficient is equal to such a 
value obtained by dividing the compression 
ratio of the coding system before the coding 
system is converted by the compression ratio 
of the coding system after the coding system is so 
converted. 

10. An image coding system converting apparatus as 
claimed in claim 7, or 8 wherein: 

35 

said added information data contains the data 
amount information of said picture; 
said coding means includes upper limit data 
amount calculating means for calculating an 
upper limit data amount of said picture based 40 
upon the data amount information of said pic- 
ture; and 

said transforming coefficient is equal to such a 
value calculated by a ratio of the data amount 
indicated by said data amount information of 45 
the picture to said upper firrut amount of the pic- 
ture calculated by said upper limit data amount 
calculating means. 

11. An image coding system converting apparatus as so 
claimed in claim 7, or 8 wherein: 

said transforming coefficient is equal to a pre- 
determined value which is previously deter- 
mined in response to the quantizing parameter ss 
indicated by the quantizing parameter informa- 
tion every combination between the coding 
system before being converted and the coding 



system after being converted. 

12. An image coding system converting apparatus as 
claimed in claim 3. 4, 5, or 6 wherein: 

said quantizing parameter output means deter- 
mines a new quantizing parameter of a subject 
block based upon quantizing parameters of a 
plurality of continuous blocks subsequent to 
said subject block with respect to the block 
which is inverse-orthogonal-transformed and 
dequantized by said decoding means. 

13. An image coding system converting apparatus as 
claimed in claim 12 wherein: 

when said image coding system converting 
apparatus outputs image data which has been 
coded in connection with the MPEG-4 stand- 
ard, 

said quantizing parameter output means reads 
the respective quantizing parameters of a plu- 
rality of continuous macroblocks with respect to 
a subject block, which is inverse-orthogonal- 
transformed and dequantized by said decoding 
means so as to determine a set region of 
adjoining macroblocks whose quantizing 
parameters are smaller than a predetermined 
value; and determines a quantizing parameter 
of a subject macroblock based upon quantizing 
parameters of a plurality of continuous macrob- 
locks subsequent to said subject macroblock 
within said set region. 

14. An image coding system converting method com- 
prising: 

a separation step which separates input data 
into coded image data and added information 
data, said image data being produced by cod- 
ing a picture in the unit of a block, which owns 
a plurality of blocks constituted by a predeter- 
mined number of pixels, and said added infor- 
mation data containing data amount 
information of said picture; 
a decoding step for inverse-orthogonal-trans- 
forming said coded image data; 
an allocation step which allocates an upper 
limit data amount to the respective blocks 
owned by said picture based upon the data 
amount information of said picture; and 
a coding step for cutting data of a subject block 
in such a case that a data amount of said sub- 
ject block is larger than, or equal to said upper 
limit data amount allocated to said subject 
block, and for inverse-orthogonal-trar^forming 
the cut data 
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15. An image coding system converting method com- 
prising: 

a separation step which separates input data 
into coded image data and added information s 
data, said image data being produced by cod- 
ing a picture in the unit of a block, which owns 
a plurality of blocks constituted by a predeter- 
mined number of pixels, and said added infor- 
mation data containing data amount 10 
information of a plurality of blocks; 
a decoding step for inverse-orthogonal-trans- 
forming said coded image data; 
an allocation step which sets an upper limit 
data amount of the respective blocks based 75 
upon the data amount information of said pic- 
ture; and 

a coding step for cutting data of a subject block 
in such a case that a data amount of said sub- 
ject block is larger than, or equal to said upper 20 
limit data amount set to said subject block, and 
for inverse-orthogonal -transforming the cut 
data. 

16. An image coding system converting method com- 25 
prising: 

a separation step which separates input data 
into coded image data and added information 
data, said image data being produced by cod- 30 
ing a picture in the unit of a block, which owns 
a plurality of blocks constituted by a predeter- 
mined number of pixels, and said added infor- 
mation data containing coding information of 
each block and quantizing parameter informa- 35 
tion; 

a block coding system judging step for judging 
a coding system of said subject block with ref- 
erence to coding information of said subject 
block; 40 
a decoding step for executing either an inverse- 
orthogonal-transform operation and a dequan- 
tizing operation with respect to said subject 
block in response to a judgement result made 
of said block coding system judging step; 45 
a coding step including a quantizing parameter 
output step for outputting a new quantizing 
parameter based upon said quantizing param- 
eter information, wherein a f irst coding step is 
performed which orthogonal-transforms such a so 
block which has been inverse-orthogonal- 
transformed by said decoding step without 
quantizing said block; and 
a coding step wherein as to such a block which 
has been inverse-orthogonal-transformed and ss 
dequarrtized by said decoding step, after said 
new quantizing parameter outputted from said 
quantizing parameter output step is multiplied 



by a DCT coefficient of said block a second 
coding step quantizes and also orthogonal- 
transforms said block. 

17. An image coding system converting method as 
claimed in claim 16 wherein: 

said block coding system judging step judges 
as to whether said subject block corresponds 
to an intra-coded block, or inter-coded block; 
and 

when said block coding system judging step 
judges that said subject block corresponds to 
the intra-coded block, said decoding step 
inverse-orthogonal-transforms said si&ject 
block judged as the intra-coded block, whereas 
when said block coding system judging step 
judges that said subject block corresponds to 
the inter-coded block, said decoding step 
inverse-orthogonal-transforms and also 
dequantizes said subject block judged as the 
inter-coded block. 

18. An image coding system converting method as 
claimed in claim 16 wherein: 

said block coding system judging step judges 
as to whether said subject block corresponds 
to an intra-coded block, or inter-coded block; 
and 

when said block coding system judging step 
judges that said subject block corresponds to 
the intra-coded block, said decoding step 
inverse-orthogonal-transforms said subject 
block judged as the intra-coded block, whereas 
when said block coding system judging step 
judges that said subject block corresponds to 
the inter-coded block, and further judges as to 
whether a coding system of a block belonging 
to a frame time-sequentially succeeded to the 
frame to which said subject block, and located 
at the same position of said subject block cor- 
responds to an intra-coded block, or an inter- 
coded block, 

when said judged block corresponds to the 
intra-coded block, said decoding step inverse- 
orthogonal-transforms said subject block 
judged as the intra-coded block, 
when said judged block corresponds to the 
intra-coded block, said decoding step inverse- 
orthogonal-transforms and also dequantizes 
said subject block judged as the inter-coded 
block. 

19. An image coding system converting method as 
claimed in claim 16 wherein: 

said added information contains bit amount 
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information of each ol said blocks; 
said block coding system judging step judges 
as to whether said subject block corresponds 
to an intra-coded block, or inter-coded block; 
and 5 
when said block coding system judging step 
judges that said subject block corresponds to 
the intra-coded block, said decoding step 
inverse-orthogonal-transforms said subject 
block judged as the intra-coded block, whereas i o 
when said block coding system judging step 
judges that said subject block corresponds to 
the inter-coded block, said decoding step either 
inverse-orthogonal-transforms or inverse- 
orthogonal -transforms and also dequantizes is 
said subject block judged as the inter-coded 
block based upon an activity indicative of a 
degree of coding difficulty which is acquired by 
multiplying the bit amount of said subject block 
by a quantizing parameter. so 

20. An image coding system converting method as 
claimed in claim 16, 17, 18, or 19 wherein: 



said transforming coefficient is equal to such a 
value obtained by dividing the compression 
ratio of the coding system before the coding 
system is converted by the compression ratio 
of the coding system after the coding system is 
converted. 

23. An image coding system converting method as 
claimed in claim 20, or 21 wherein: 

said added information data contains the data 
amount information of said picture; 
said coding step includes an upper limit data 
amount calculating step for calculating an 
upper limit data amount of said picture based 
upon the data amount information of said pic- 
ture; and 

said transforming coefficient is equal to such a 
value calculated by a ratio of the data amount 
indicated by said data amount information of 
the picture to said upper limit amount of the pic- 
ture calculated by said upper limit data amount 
calculating step. 



said quantizing parameter output step includes 25 24. An image coding system converting method as 

a transforming-coefficient calculating step for claimed in claim 20, or 21 wherein; 
calculating a transforming coefficient based 

upon a difference in compression ratios said transforming coefficient is equal to a pre- 

beforetafter the image coding systems are con- determined value which is previously deter- 

verted; and 30 mined in response to the quantizing parameter 

when the transforming coefficient calculated by indicated by the quantizing parameter informa- 

said transforming-coefficient calculating step is tion every combination between the coding 

larger than 1 , said quantizing parameter output system before being converted and the coding 

step sets a new quantizing parameter as a mul- system after being converted, 

tiplier indicated by said quantizing parameter 35 

information; whereas when said transforming 25. An image coding system converting method as 

coefficient is smaller than 1. said quantizing claimed in claim 16, 17. 18, or 19 wherein: 
parameter output step sets a new quantizing 

parameter as a divisor indicated by said quan- said quantizing parameter output step deter- 

tizing parameter information and outputs said 40 mines a new quantizing parameter of a subject 

new quantizing parameter. block based upon quantizing parameters of a 

plurality of continuous blocks subsequent to 

21. An image coding system converting method as said subject block with respect to the block 
claimed in claim 20 wherein: which is inverse-orthogonal-transformed and 

45 dequantized by said decoding step. 

said quantizing parameter output step outputs 

said original DCT coefficient as a DCT coeffi- 26. An image coding system converting method as 

cierrt as said block in such a case that while claimed in claim 25 wherein: 
either the multiplier of the quantizing parameter 

or the divisor thereof indicated by said quantiz- so when said image coding system converting 
ing parameter information is used as said new method outputs image data which has been 
quantizing parameter, a DCT coefficient coded in connection with the MPEG-4 stand- 
obtained by multiplying a DCT coefficient of a ard, 

block by said multiplier, or said divisor becomes said quantizing parameter output step reads 

smaller than the original DCT coefficient 55 the respective quantizing parameters of a plu- 
rality of continuous macroblocks with respect to 

22. An image coding system converting method as a subject block which is inverse-orthogonal - 
claimed in claim 20. or 21 wherein: transformed and dequantized by said decoding 
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step so as to determine a set region of adjoin- 
ing macroblocks whose quantizing parameters 
are smaller than a predetermined value; and 
determines a quantizing parameter of a subject 
macroblock based upon quantizing parameters 5 
of a plurality of continuous macroblocks subse- 
quent to said subject macroblock within said 
set region. 

27. A recording medium for recording thereon as a 10 
computer readable program, the image coding sys- 
tem converting method as recited in any one ol the 
preceding claims 1 4 to 26. 
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